公开(公告)号：US11647210B2

公开(公告)日：2023-05-09

申请号：US17498859

申请日：2021-10-12

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Pilkyu Park ,  Youngo Park ,  Jongseok Lee ,  Yumi Sohn ,  Myungjin Eom

IPC: G06N3/04 ,  G06N3/08 ,  G06T3/40 ,  H04N19/132 ,  H04N19/146 ,  H04N19/172 ,  H04N19/182 ,  H04N19/184 ,  H04N19/30 ,  H04N19/42 ,  H04N19/59 ,  H04N19/70 ,  H04N19/85 ,  H04N19/50

CPC classification number: H04N19/30 ,  H04N19/146 ,  H04N19/172 ,  H04N19/42 ,  H04N19/70

Abstract: Provided is a computer-recordable recording medium having stored thereon a video file including artificial intelligence (AI) encoding data, wherein the AI encoding data includes: image data including encoding information of a low resolution image generated by AI down-scaling a high resolution image; and AI data about AI up-scaling of the low resolution image reconstructed according to the image data, wherein the AI data includes: AI target data indicating whether AI up-scaling is to be applied to at least one frame; and AI supplementary data about up-scaling deep neural network (DNN) information used for AI up-scaling of the at least one frame from among a plurality of pieces of pre-set default DNN configuration information, when AI up-scaling is applied to the at least one frame.

公开(公告)号：US11288770B2

公开(公告)日：2022-03-29

申请号：US17079773

申请日：2020-10-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T3/40 ,  G06T9/00 ,  G06N3/08 ,  H04N19/85 ,  G06N20/10

Abstract: An artificial intelligence (AI) decoding apparatus includes a memory storing one or more instructions, and a processor configured to execute the stored one or more instructions, to obtain image data corresponding to a first image that is encoded, obtain a second image corresponding to the first image by decoding the obtained image data, determine whether to perform AI up-scaling of the obtained second image, based on the AI up-scaling of the obtained second image being determined to be performed, obtain a third image by performing the AI up-scaling of the obtained second image through an up-scaling deep neural network (DNN), and output the obtained third image, and based on the AI up-scaling of the obtained second image being determined to be not performed, output the obtained second image.

公开(公告)号：US20210390659A1

公开(公告)日：2021-12-16

申请号：US17237775

申请日：2021-04-22

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan KIM ,  Youngo Park ,  Kwangpyo CHOI

IPC: G06T3/40 ,  G06T9/00 ,  G06N3/08 ,  G06N3/04

Abstract: An artificial intelligence (AI) encoding apparatus includes a processor configured to execute one or more instructions stored in the AI encoding apparatus to: input, to a downscale deep neural network (DNN), a first reduced image downscaled from an original image and a reduction feature map having a resolution lower than a resolution of the original image; obtain a first image AI-downscaled from the original image in the downscale DNN; generate image data by performing a first encoding process on the first image; and output the image data.

公开(公告)号：US11190782B2

公开(公告)日：2021-11-30

申请号：US17080827

申请日：2020-10-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Pilkyu Park ,  Youngo Park ,  Jongseok Lee ,  Yumi Sohn ,  Myungjin Eom

IPC: H04N19/132 ,  H04N19/146 ,  H04N19/172 ,  H04N19/182 ,  H04N19/30 ,  H04N19/42 ,  H04N19/59 ,  H04N19/70 ,  H04N19/85

Abstract: Provided is a computer-recordable recording medium having stored thereon a video file including artificial intelligence (AI) encoding data, wherein the AI encoding data includes: image data including encoding information of a low resolution image generated by AI down-scaling a high resolution image; and AI data about AI up-scaling of the low resolution image reconstructed according to the image data, wherein the AI data includes: AI target data indicating whether AI up-scaling is to be applied to at least one frame; and AI supplementary data about up-scaling deep neural network (DNN) information used for AI up-scaling of the at least one frame from among a plurality of pieces of pre-set default DNN configuration information, when AI up-scaling is applied to the at least one frame.

公开(公告)号：US11170534B2

公开(公告)日：2021-11-09

申请号：US17082848

申请日：2020-10-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T9/00 ,  G06T3/40 ,  H04N19/85

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.

公开(公告)号：US10825141B1

公开(公告)日：2020-11-03

申请号：US16843515

申请日：2020-04-08

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo Park ,  Kwangpyo Choi ,  Yumi Sohn ,  Sungchan Kim ,  Myungjin Eom

IPC: G06T3/40 ,  G06N3/08 ,  H04N19/85

Abstract: Provided is a decoding apparatus including: a communication interface configured to receive AI encoding data generated as a result of artificial intelligence (AI) down-scaling and first encoding of an original image; a processor configured to divide the AI encoding data into image data and AI data; and an input/output (I/O) device, wherein the processor is further configured to: obtain a second image by performing first decoding on a first image obtained by performing AI down-scaling on the original image, based on the image data; and control the I/O device to transmit the second image and the AI data to an external apparatus. In some embodiments, the external apparatus performs an AI upscaling of the second image using the AI data, and displays the resulting third image.

公开(公告)号：US20230386193A1

公开(公告)日：2023-11-30

申请号：US18224756

申请日：2023-07-21

Applicant: Samsung Electronics CO., LTD.

Inventor： Chaeeun LEE ,  Pilkyu Park ,  Jaehwan Kim ,  Heechul Yang ,  Jongseok Lee ,  Youngo Park ,  Kwangpyo Chol

IPC: G06V10/82 ,  H04N23/60 ,  H04N23/667 ,  G06T5/00

CPC classification number: G06V10/82 ,  H04N23/64 ,  H04N23/667 ,  G06T5/002

Abstract: A method of processing an image by using a neural network model includes obtaining an image captured via an image sensor, identifying a shooting context of the image, selecting a neural network model included in at least one of an image reconstruction module or an image correction module according to the shooting context, and processing the image by using the selected neural network model.

公开(公告)号：US11816872B2

公开(公告)日：2023-11-14

申请号：US17503420

申请日：2021-10-18

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Chaeeun Lee ,  Jaehwan Kim ,  Youngo Park

IPC: G06T9/00 ,  G06N3/08 ,  G06T3/40 ,  G06V10/44 ,  G06V10/82

CPC classification number: G06T9/002 ,  G06N3/08 ,  G06T3/4046 ,  G06V10/454 ,  G06V10/82

Abstract: An apparatus for performing artificial intelligence (AI) encoding on an image includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to: determine a resolution of an original image; when the resolution of the original image is higher than a predetermined value, obtain a first image by performing AI downscaling on the original image via a downscaling deep neural network (DNN); when the resolution of the original image is lower than or equal to the predetermined value, obtain a first image by performing AI one-to-one preprocessing on the original image via a one-to-one preprocessing DNN for upscaling; generate image data by performing first encoding on the first image; and transmit the image data and AI data including information related to the AI downscaling or information related to the AI one-to-one preprocessing.

公开(公告)号：US11756159B2

公开(公告)日：2023-09-12

申请号：US17331162

申请日：2021-05-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo Park ,  Kwangpyo Choi ,  Yumi Sohn ,  Sungchan Kim ,  Myungjin Eom

IPC: G06T3/40 ,  H04N19/85 ,  G06T9/00 ,  G06N3/08

CPC classification number: G06T3/4046 ,  G06T9/002 ,  H04N19/85 ,  G06N3/08 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Provided is a decoding apparatus including: a communication interface configured to receive AI encoding data generated as a result of artificial intelligence (AI) down-scaling and first encoding of an original image; a processor configured to divide the AI encoding data into image data and AI data; and an input/output (I/O) device, wherein the processor is further configured to: obtain a second image by performing first decoding on a first image obtained by performing AI down-scaling on the original image, based on the image data; and control the I/O device to transmit the second image and the AI data to an external apparatus. In some embodiments, the external apparatus performs an AI upscaling of the second image using the AI data, and displays the resulting third image.

公开(公告)号：US11663747B2

公开(公告)日：2023-05-30

申请号：US17383533

申请日：2021-07-23

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T9/00 ,  G06T3/40 ,  H04N19/85 ,  G06V10/82

CPC classification number: G06T9/002 ,  G06T3/4046 ,  G06V10/82 ,  H04N19/85 ,  G06T2207/20081

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.