公开(公告)号：US11810332B2

公开(公告)日：2023-11-07

申请号：US17495050

申请日：2021-10-06

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jongseok Lee ,  Jaehwan Kim ,  Youngo Park

IPC: G06T9/00 ,  G06N3/08 ,  G06T3/40 ,  G06N3/082

CPC classification number: G06T9/002 ,  G06N3/082 ,  G06T3/4046

Abstract: An artificial intelligence (AI) decoding method including obtaining image data generated from performing first encoding on a first image and AI data related to AI down-scaling of at least one original image related to the first image; obtaining a second image corresponding to the first image by performing first decoding on the image data; obtaining, based on the AI data, deep neural network (DNN) setting information for performing AI up-scaling of the second image; and generating a third image by performing the AI up-scaling on the second image via an up-scaling DNN operating according to the obtained DNN setting information. The DNN setting information is DNN information updated for performing the AI up-scaling of at least one second image via joint training of the up-scaling DNN and a down-scaling DNN used for the AI down-scaling.

公开(公告)号：US11748847B2

公开(公告)日：2023-09-05

申请号：US17385995

申请日：2021-07-27

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo Park ,  Yumi Sohn ,  Myungjin Eom ,  Kwangpyo Choi

IPC: G06T3/40 ,  H04N19/85 ,  H04L65/70 ,  H04L65/80 ,  H04L65/75

CPC classification number: G06T3/4046 ,  H04L65/70 ,  H04L65/762 ,  H04L65/80 ,  H04N19/85

Abstract: A terminal for receiving streaming data may receive information of a plurality of different quality versions of an image content; request, based on the information, a server for a version of the image content from among the plurality of different quality versions of the image content; when the requested version of the image content and artificial intelligence (AI) data corresponding to the requested version of the image content are received, determines whether to perform AI upscaling on the received version of the image content, based on the AI data; and based on a result of the determining whether to perform AI upscaling, performs AI upscaling on the received version of the image content through a upscaling deep neural network (DNN) that is trained jointly with a downscaling DNN of the server.

公开(公告)号：US20220138904A1

公开(公告)日：2022-05-05

申请号：US17575691

申请日：2022-01-14

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T3/40 ,  G06T9/00 ,  G06N3/08 ,  H04N19/85 ,  G06N20/10

Abstract: An artificial intelligence (AI) decoding apparatus includes a memory storing one or more instructions, and a processor configured to execute the stored one or more instructions, to obtain image data corresponding to a first image that is encoded, obtain a second image corresponding to the first image by decoding the obtained image data, determine whether to perform AI up-scaling of the obtained second image, based on the AI up-scaling of the obtained second image being determined to be performed, obtain a third image by performing the AI up-scaling of the obtained second image through an up-scaling deep neural network (DNN), and output the obtained third image, and based on the AI up-scaling of the obtained second image being determined to be not performed, output the obtained second image.

公开(公告)号：US11270469B2

公开(公告)日：2022-03-08

申请号：US17333845

申请日：2021-05-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Chaeeun Lee ,  Jaehwan Kim ,  Youngo Park

IPC: G06T3/40 ,  G06N3/04 ,  G06N3/08 ,  G06T9/00

Abstract: An apparatus for performing artificial intelligence (AI) encoding on an image includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to: determine a resolution of an original image; when the resolution of the original image is higher than a predetermined value, obtain a first image by performing AI downscaling on the original image via a downscaling deep neural network (DNN); when the resolution of the original image is lower than or equal to the predetermined value, obtain a first image by performing AI one-to-one preprocessing on the original image via a one-to-one preprocessing DNN for upscaling; generate image data by performing first encoding on the first image; and transmit the image data and AI data including information related to the AI downscaling or information related to the AI one-to-one preprocessing.

公开(公告)号：US11200639B1

公开(公告)日：2021-12-14

申请号：US17237775

申请日：2021-04-22

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T3/40 ,  G06N3/04 ,  G06N3/08 ,  G06T9/00

Abstract: An artificial intelligence (AI) encoding apparatus includes a processor configured to execute one or more instructions stored in the AI encoding apparatus to: input, to a downscale deep neural network (DNN), a first reduced image downscaled from an original image and a reduction feature map having a resolution lower than a resolution of the original image; obtain a first image AI-downscaled from the original image in the downscale DNN; generate image data by performing a first encoding process on the first image; and output the image data.

公开(公告)号：US11182876B2

公开(公告)日：2021-11-23

申请号：US17184250

申请日：2021-02-24

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Youngo Park ,  Heechul Yang ,  Chaeeun Lee

IPC: G06T3/40 ,  G06T9/00

Abstract: An artificial intelligence (AI) decoding apparatus includes a memory storing one or more instructions; and a processor configured to execute the one or more instructions to obtain image data generated through first encoding on a first image; obtain a second image corresponding to the first image by performing first decoding on the image data; perform pre-processing of changing a resolution of the second image, according to a pre-determined output resolution; and obtain a fourth image having the pre-determined output resolution by applying AI up-scaling based on an up-scaling deep neural network (DNN) to a third image obtained as a result of the pre-processing.

公开(公告)号：US11170472B2

公开(公告)日：2021-11-09

申请号：US17080501

申请日：2020-10-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo Park ,  Yumi Sohn ,  Myungjin Eom ,  Kwangpyo Choi

IPC: G06T3/40 ,  H04L29/06 ,  H04N19/85

Abstract: A terminal for receiving streaming data may receive information of a plurality of different quality versions of an image content; request, based on the information, a server for a version of the image content from among the plurality of different quality versions of the image content; when the requested version of the image content and artificial intelligence (AI) data corresponding to the requested version of the image content are received, determines whether to perform AI upscaling on the received version of the image content, based on the AI data; and based on a result of the determining whether to perform AI upscaling, performs AI upscaling on the received version of the image content through a upscaling deep neural network (DNN) that is trained jointly with a downscaling DNN of the server.

公开(公告)号：US11164340B2

公开(公告)日：2021-11-02

申请号：US17180358

申请日：2021-02-19

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jongseok Lee ,  Jaehwan Kim ,  Youngo Park

IPC: G06T9/00 ,  G06N3/08 ,  G06T3/40

Abstract: An artificial intelligence (AI) decoding method including obtaining image data generated from performing first encoding on a first image and AI data related to AI down-scaling of at least one original image related to the first image; obtaining a second image corresponding to the first image by performing first decoding on the image data; obtaining, based on the AI data, deep neural network (DNN) setting information for performing AI up-scaling of the second image; and generating a third image by performing the AI up-scaling on the second image via an up-scaling DNN operating according to the obtained DNN setting information. The DNN setting information is DNN information updated for performing the AI up-scaling of at least one second image via joint training of the up-scaling DNN and a down-scaling DNN used for the AI down-scaling.

公开(公告)号：US11138691B2

公开(公告)日：2021-10-05

申请号：US17080543

申请日：2020-10-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo Park ,  Yumi Sohn ,  Myungjin Eom ,  Kwangpyo Choi

IPC: G06T3/40 ,  H04L29/06 ,  H04N19/85

Abstract: A terminal for receiving streaming data may receive information of a plurality of different quality versions of an image content; request, based on the information, a server for a version of the image content from among the plurality of different quality versions of the image content; when the requested version of the image content and artificial intelligence (AI) data corresponding to the requested version of the image content are received, determines whether to perform AI upscaling on the received version of the image content, based on the AI data; and based on a result of the determining whether to perform AI upscaling, performs AI upscaling on the received version of the image content through a upscaling deep neural network (DNN) that is trained jointly with a downscaling DNN of the server.

公开(公告)号：US11107190B2

公开(公告)日：2021-08-31

申请号：US17098907

申请日：2020-11-16

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo Park ,  Kwangpyo Choi ,  Yumi Sohn ,  Sungchan Kim ,  Myungjin Eom

IPC: G06T3/40 ,  G06N3/08 ,  G06T9/00 ,  H04N19/85

Abstract: Provided is a decoding apparatus including: a communication interface configured to receive AI encoding data generated as a result of artificial intelligence (AI) down-scaling and first encoding of an original image; a processor configured to divide the AI encoding data into image data and AI data; and an input/output (I/O) device, wherein the processor is further configured to: obtain a second image by performing first decoding on a first image obtained by performing AI down-scaling on the original image, based on the image data; and control the I/O device to transmit the second image and the AI data to an external apparatus. In some embodiments, the external apparatus performs an AI upscaling of the second image using the AI data, and displays the resulting third image.