公开(公告)号：US20230085530A1

公开(公告)日：2023-03-16

申请号：US17895561

申请日：2022-08-25

Applicant: Samsung Electronics Co., Ltd.

Inventor： Chaeeun Lee ,  Jaehwan Kim ,  Youngo Park ,  Jongseok Lee ,  Kwangpyo Choi

IPC: H04N19/30 ,  H04N19/436 ,  H04N19/136 ,  H04N19/164

Abstract: Provided is an electronic device configured to participate in video conference by using artificial intelligence (AI), the electronic device including a display and a processor configured to execute one or more instructions. The processor configured to obtain, from a server, image data generated by first encoding first image related to another electronic device participating in video conference, and AI data related to AI downscaling from original image to first image, obtain second image corresponding to first image by performing first decoding on image data, determine whether to perform AI upscaling on second image, based on importance of the other electronic device, based on determining to perform AI upscaling, obtain third image by performing AI upscaling on second image through an upscaling deep neural network and provide third image to display, and based on determining not to perform AI upscaling, provide second image to display.

公开(公告)号：US11405637B2

公开(公告)日：2022-08-02

申请号：US17081364

申请日：2020-10-27

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jongseok Lee ,  Youngo Park ,  Pilkyu Park ,  Yumi Sohn

IPC: H04N19/59 ,  G06T3/40 ,  H04N19/61 ,  H04N19/172 ,  G06N3/04

Abstract: Methods and apparatuses for image encoding and image decoding are provided. The image decoding method includes: obtaining deep neural network (DNN) update permission information indicating whether one or more pieces of DNN setting information are updated; based on the DNN update permission information indicating that the one or more pieces of the DNN setting information are updated, obtaining DNN update information necessary for determining one or more pieces of the DNN setting information that are updated; determining the one or more pieces of the updated DNN setting information according to the DNN update information; and obtaining a third image by performing artificial intelligence (AI) up-scaling on a second image according to the one or more pieces of the updated DNN setting information.

公开(公告)号：US20220207650A1

公开(公告)日：2022-06-30

申请号：US17696518

申请日：2022-03-16

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan KIM ,  Jongseok Lee ,  Youngo Park ,  Chaeeun Lee

IPC: G06T3/40

Abstract: An AI decoding apparatus includes a memory storing instructions and a processor configured to execute the instructions to obtain AI data related to AI down-scaling of an original image and image data generated as a result of encoding a first image, obtain a second image corresponding to the first image by decoding the image data, determine a resolution ratio in a horizontal direction and a resolution ratio in a vertical direction between the original image and the first image, based on the AI data, and obtain, by an up-scaling deep neural network (DNN), a third image in which a resolution in at least one of a horizontal direction and a vertical direction is increased from the second image based on the resolution ratio in the horizontal direction and the resolution ratio in the vertical direction.

公开(公告)号：US20220036596A1

公开(公告)日：2022-02-03

申请号：US17503420

申请日：2021-10-18

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Chaeeun Lee ,  Jaehwan Kim ,  Youngo Park

IPC: G06T9/00 ,  G06N3/08 ,  G06T3/40

Abstract: An apparatus for performing artificial intelligence (AI) encoding on an image includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to: determine a resolution of an original image; when the resolution of the original image is higher than a predetermined value, obtain a first image by performing AI downscaling on the original image via a downscaling deep neural network (DNN); when the resolution of the original image is lower than or equal to the predetermined value, obtain a first image by performing AI one-to-one preprocessing on the original image via a one-to-one preprocessing DNN for upscaling; generate image data by performing first encoding on the first image; and transmit the image data and AI data including information related to the AI downscaling or information related to the AI one-to-one preprocessing.

公开(公告)号：US20210350586A1

公开(公告)日：2021-11-11

申请号：US17383533

申请日：2021-07-23

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan KIM ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T9/00 ,  G06T3/40 ,  H04N19/85

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.

公开(公告)号：US11132765B2

公开(公告)日：2021-09-28

申请号：US17080501

申请日：2020-10-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo Park ,  Yumi Sohn ,  Myungjin Eom ,  Kwangpyo Choi

IPC: G06T3/40 ,  H04L29/06 ,  H04N19/85

Abstract: A terminal for receiving streaming data may receive information of a plurality of different quality versions of an image content; request, based on the information, a server for a version of the image content from among the plurality of different quality versions of the image content; when the requested version of the image content and artificial intelligence (AI) data corresponding to the requested version of the image content are received, determines whether to perform AI upscaling on the received version of the image content, based on the AI data; and based on a result of the determining whether to perform AI upscaling, performs AI upscaling on the received version of the image content through a upscaling deep neural network (DNN) that is trained jointly with a downscaling DNN of the server.

公开(公告)号：US10832447B2

公开(公告)日：2020-11-10

申请号：US16844124

申请日：2020-04-09

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Sunyoung Jeon ,  Jaehwan Kim ,  Youngo Park ,  Jongseok Lee ,  Minseok Choi ,  Kwangpyo Choi

IPC: G06T9/00 ,  H04N19/86 ,  G06N3/04 ,  G06N3/08 ,  G06T3/40 ,  G06T5/00 ,  G06T5/20 ,  G06T5/50

Abstract: Provided is an artificial intelligence (AI) encoding apparatus including a memory storing one or more instructions, and a processor configured to execute the one or more instructions stored in the memory to obtain a first image by performing AI down-scaling on an original image through a deep neural network (DNN) for down-scaling, obtain artifact information indicating an artifact region in the first image, perform post-processing to change a pixel value of a pixel in the first image, based on the artifact information, and obtain image data corresponding to a result of encoding of the post-processed first image, and AI data including the artifact information.

公开(公告)号：US10825204B2

公开(公告)日：2020-11-03

申请号：US16785092

申请日：2020-02-07

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Sunyoung Jeon ,  Jaehwan Kim ,  Youngo Park ,  Jongseok Lee ,  Minseok Choi ,  Kwangpyo Choi

IPC: G06T9/00 ,  G06T5/00 ,  G06T5/50 ,  G06T3/40 ,  G06N3/04 ,  G06N3/08 ,  G06T5/20 ,  H04N19/86

Abstract: Provided is an artificial intelligence (AI) encoding apparatus including a memory storing one or more instructions, and a processor configured to execute the one or more instructions stored in the memory to obtain a first image by performing AI down-scaling on an original image through a deep neural network (DNN) for down-scaling, obtain artifact information indicating an artifact region in the first image, perform post-processing to change a pixel value of a pixel in the first image, based on the artifact information, and obtain image data corresponding to a result of encoding of the post-processed first image, and AI data including the artifact information.

公开(公告)号：US10819992B2

公开(公告)日：2020-10-27

申请号：US16743613

申请日：2020-01-15

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Pilkyu Park ,  Youngo Park ,  Jongseok Lee ,  Yumi Sohn ,  Myungjin Eom

IPC: H04N19/132 ,  H04N19/146 ,  H04N19/172 ,  H04N19/182 ,  H04N19/30 ,  H04N19/42 ,  H04N19/59 ,  H04N19/70 ,  H04N19/85

Abstract: Provided is a computer-recordable recording medium having stored thereon a video file including artificial intelligence (AI) encoding data, wherein the AI encoding data includes: image data including encoding information of a low resolution image generated by AI down-scaling a high resolution image; and AI data about AI up-scaling of the low resolution image reconstructed according to the image data, wherein the AI data includes: AI target data indicating whether AI up-scaling is to be applied to at least one frame; and AI supplementary data about up-scaling deep neural network (DNN) information used for AI up-scaling of the at least one frame from among a plurality of pieces of pre-set default DNN configuration information, when AI up-scaling is applied to the at least one frame.

公开(公告)号：US10817985B2

公开(公告)日：2020-10-27

申请号：US16656812

申请日：2019-10-18

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T3/40 ,  G06T9/00 ,  G06N3/08 ,  H04N19/85 ,  G06N20/10

Abstract: An artificial intelligence (AI) decoding apparatus includes a memory storing one or more instructions, and a processor configured to execute the stored one or more instructions, to obtain image data corresponding to a first image that is encoded, obtain a second image corresponding to the first image by decoding the obtained image data, determine whether to perform AI up-scaling of the obtained second image, based on the AI up-scaling of the obtained second image being determined to be performed, obtain a third image by performing the AI up-scaling of the obtained second image through an up-scaling deep neural network (DNN), and output the obtained third image, and based on the AI up-scaling of the obtained second image being determined to be not performed, output the obtained second image.