公开(公告)号：US20210350586A1

公开(公告)日：2021-11-11

申请号：US17383533

申请日：2021-07-23

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan KIM ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T9/00 ,  G06T3/40 ,  H04N19/85

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.

公开(公告)号：US11132765B2

公开(公告)日：2021-09-28

申请号：US17080501

申请日：2020-10-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo Park ,  Yumi Sohn ,  Myungjin Eom ,  Kwangpyo Choi

IPC: G06T3/40 ,  H04L29/06 ,  H04N19/85

Abstract: A terminal for receiving streaming data may receive information of a plurality of different quality versions of an image content; request, based on the information, a server for a version of the image content from among the plurality of different quality versions of the image content; when the requested version of the image content and artificial intelligence (AI) data corresponding to the requested version of the image content are received, determines whether to perform AI upscaling on the received version of the image content, based on the AI data; and based on a result of the determining whether to perform AI upscaling, performs AI upscaling on the received version of the image content through a upscaling deep neural network (DNN) that is trained jointly with a downscaling DNN of the server.

公开(公告)号：US20210073947A1

公开(公告)日：2021-03-11

申请号：US17098907

申请日：2020-11-16

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo PARK ,  Kwangpyo Choi ,  Yumi Sohn ,  Sungchan Kim ,  Myungjin Eom

IPC: G06T3/40 ,  G06N3/08 ,  H04N19/85 ,  G06T9/00

Abstract: Provided is a decoding apparatus including: a communication interface configured to receive AI encoding data generated as a result of artificial intelligence (AI) down-scaling and first encoding of an original image; a processor configured to divide the AI encoding data into image data and AI data; and an input/output (I/O) device, wherein the processor is further configured to: obtain a second image by performing first decoding on a first image obtained by performing AI down-scaling on the original image, based on the image data; and control the I/O device to transmit the second image and the AI data to an external apparatus. In some embodiments, the external apparatus performs an AI upscaling of the second image using the AI data, and displays the resulting third image.

公开(公告)号：US10832447B2

公开(公告)日：2020-11-10

申请号：US16844124

申请日：2020-04-09

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Sunyoung Jeon ,  Jaehwan Kim ,  Youngo Park ,  Jongseok Lee ,  Minseok Choi ,  Kwangpyo Choi

IPC: G06T9/00 ,  H04N19/86 ,  G06N3/04 ,  G06N3/08 ,  G06T3/40 ,  G06T5/00 ,  G06T5/20 ,  G06T5/50

Abstract: Provided is an artificial intelligence (AI) encoding apparatus including a memory storing one or more instructions, and a processor configured to execute the one or more instructions stored in the memory to obtain a first image by performing AI down-scaling on an original image through a deep neural network (DNN) for down-scaling, obtain artifact information indicating an artifact region in the first image, perform post-processing to change a pixel value of a pixel in the first image, based on the artifact information, and obtain image data corresponding to a result of encoding of the post-processed first image, and AI data including the artifact information.

公开(公告)号：US10825204B2

公开(公告)日：2020-11-03

申请号：US16785092

申请日：2020-02-07

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Sunyoung Jeon ,  Jaehwan Kim ,  Youngo Park ,  Jongseok Lee ,  Minseok Choi ,  Kwangpyo Choi

IPC: G06T9/00 ,  G06T5/00 ,  G06T5/50 ,  G06T3/40 ,  G06N3/04 ,  G06N3/08 ,  G06T5/20 ,  H04N19/86

Abstract: Provided is an artificial intelligence (AI) encoding apparatus including a memory storing one or more instructions, and a processor configured to execute the one or more instructions stored in the memory to obtain a first image by performing AI down-scaling on an original image through a deep neural network (DNN) for down-scaling, obtain artifact information indicating an artifact region in the first image, perform post-processing to change a pixel value of a pixel in the first image, based on the artifact information, and obtain image data corresponding to a result of encoding of the post-processed first image, and AI data including the artifact information.

公开(公告)号：US10817985B2

公开(公告)日：2020-10-27

申请号：US16656812

申请日：2019-10-18

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T3/40 ,  G06T9/00 ,  G06N3/08 ,  H04N19/85 ,  G06N20/10

Abstract: An artificial intelligence (AI) decoding apparatus includes a memory storing one or more instructions, and a processor configured to execute the stored one or more instructions, to obtain image data corresponding to a first image that is encoded, obtain a second image corresponding to the first image by decoding the obtained image data, determine whether to perform AI up-scaling of the obtained second image, based on the AI up-scaling of the obtained second image being determined to be performed, obtain a third image by performing the AI up-scaling of the obtained second image through an up-scaling deep neural network (DNN), and output the obtained third image, and based on the AI up-scaling of the obtained second image being determined to be not performed, output the obtained second image.

公开(公告)号：US12190471B2

公开(公告)日：2025-01-07

申请号：US17723055

申请日：2022-04-18

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Sangwook Baek ,  Sangwon Lee ,  Taekeun Kang ,  Dongkyu Kim ,  Gihyeon Bae ,  Jungmin Lee ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T3/4046 ,  G06T3/4007 ,  G06T7/00

Abstract: An image processing apparatus for performing image quality processing on an image includes: a memory configured to store one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to: obtain a first image by downscaling an input image by using a downscale network; extract first feature information corresponding to the first image by using a feature extraction network; obtain a second image by performing image quality processing on the first image based on the first feature information, by using an image quality processing network; and obtain an output image by upscaling the second image, extracting second feature information corresponding to the input image, and performing image quality processing on the upscaled second image based on the second feature information, by using an upscale network.

公开(公告)号：US12045954B2

公开(公告)日：2024-07-23

申请号：US17893248

申请日：2022-08-23

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T3/4092 ,  G06T3/10 ,  G06T3/4046 ,  G06T3/4053 ,  H04N7/01 ,  H04N7/14

CPC classification number: G06T3/4092 ,  G06T3/10 ,  G06T3/4046 ,  G06T3/4053 ,  H04N7/0102 ,  H04N7/141

Abstract: Provided is a method of adaptively performing artificial intelligence (AI) downscaling on an image during a video telephone call of a user terminal. The method includes obtaining, from an opposite user terminal, AI upscaling support information of the opposite user terminal that is a target of a video telephone call, determining whether the user terminal is to perform AI downscaling on an original image, based on the AI upscaling support information, based on determining that the user terminal is to perform AI downscaling on the original image, obtaining a first image by AI downscaling the original image using a downscaling deep neural network (DNN), generating image data by performing first encoding on the first image, and transmitting AI data including information related to the AI downscaling and the image data.

公开(公告)号：US20240202942A1

公开(公告)日：2024-06-20

申请号：US18591943

申请日：2024-02-29

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youjin LEE ,  Yongsup Park ,  Sangmi Lee ,  Gyehyun Kim ,  Beomseok Kim ,  Youngo Park ,  Taeyoung Jang ,  Kwangpyo Choi

IPC: G06T7/254 ,  G06T5/20

CPC classification number: G06T7/254 ,  G06T5/20 ,  G06T2207/20084

Abstract: An image processing device configured to obtain difference maps between a first frame or a first feature map corresponding to the first frame, and second feature maps corresponding to a second frame, obtain third feature maps and fourth feature maps by performing pooling processes on the difference maps according to a first size and a second size, obtain modified difference maps by weighted-summing the third feature maps and the fourth feature maps, identify any one collocated sample based on sizes of sample values of collocated samples of the modified difference maps corresponding to a current sample of the first frame, and determine a filter kernel used to obtain the second feature map corresponding to the modified difference map including the identified collocated sample, as a motion vector of the current sample.

公开(公告)号：US11863756B2

公开(公告)日：2024-01-02

申请号：US17677414

申请日：2022-02-22

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Quockhanh Dinh ,  Kwangpyo Choi

IPC: H04N19/137 ,  H04N19/43 ,  H04N19/51 ,  H04N19/124 ,  H04N19/91

CPC classification number: H04N19/137 ,  H04N19/124 ,  H04N19/43 ,  H04N19/51 ,  H04N19/91

Abstract: An image decoding method using artificial intelligence (AI), including obtaining feature data of a current optical flow and feature data of current differential data from a bitstream corresponding to a current image; obtaining the current optical flow by applying the feature data of the current optical flow to a neural-network-based first decoder; applying at least one of the feature data of the current optical flow and feature data of a previous optical flow to a first preprocessing neural network; obtain a first concatenation result by concatenating feature data obtained from the first preprocessing neural network with the feature data of the current differential data; obtaining the current differential data by applying the first concatenation result to a neural-network-based second decoder; and reconstructing the current image using the current differential data and a current predicted image generated from a previous reconstructed image based on the current optical flow.