公开(公告)号：US12190471B2

公开(公告)日：2025-01-07

申请号：US17723055

申请日：2022-04-18

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Sangwook Baek ,  Sangwon Lee ,  Taekeun Kang ,  Dongkyu Kim ,  Gihyeon Bae ,  Jungmin Lee ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T3/4046 ,  G06T3/4007 ,  G06T7/00

Abstract: An image processing apparatus for performing image quality processing on an image includes: a memory configured to store one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to: obtain a first image by downscaling an input image by using a downscale network; extract first feature information corresponding to the first image by using a feature extraction network; obtain a second image by performing image quality processing on the first image based on the first feature information, by using an image quality processing network; and obtain an output image by upscaling the second image, extracting second feature information corresponding to the input image, and performing image quality processing on the upscaled second image based on the second feature information, by using an upscale network.

公开(公告)号：US12045954B2

公开(公告)日：2024-07-23

申请号：US17893248

申请日：2022-08-23

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T3/4092 ,  G06T3/10 ,  G06T3/4046 ,  G06T3/4053 ,  H04N7/01 ,  H04N7/14

CPC classification number: G06T3/4092 ,  G06T3/10 ,  G06T3/4046 ,  G06T3/4053 ,  H04N7/0102 ,  H04N7/141

Abstract: Provided is a method of adaptively performing artificial intelligence (AI) downscaling on an image during a video telephone call of a user terminal. The method includes obtaining, from an opposite user terminal, AI upscaling support information of the opposite user terminal that is a target of a video telephone call, determining whether the user terminal is to perform AI downscaling on an original image, based on the AI upscaling support information, based on determining that the user terminal is to perform AI downscaling on the original image, obtaining a first image by AI downscaling the original image using a downscaling deep neural network (DNN), generating image data by performing first encoding on the first image, and transmitting AI data including information related to the AI downscaling and the image data.

公开(公告)号：US20240202942A1

公开(公告)日：2024-06-20

申请号：US18591943

申请日：2024-02-29

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youjin LEE ,  Yongsup Park ,  Sangmi Lee ,  Gyehyun Kim ,  Beomseok Kim ,  Youngo Park ,  Taeyoung Jang ,  Kwangpyo Choi

IPC: G06T7/254 ,  G06T5/20

CPC classification number: G06T7/254 ,  G06T5/20 ,  G06T2207/20084

Abstract: An image processing device configured to obtain difference maps between a first frame or a first feature map corresponding to the first frame, and second feature maps corresponding to a second frame, obtain third feature maps and fourth feature maps by performing pooling processes on the difference maps according to a first size and a second size, obtain modified difference maps by weighted-summing the third feature maps and the fourth feature maps, identify any one collocated sample based on sizes of sample values of collocated samples of the modified difference maps corresponding to a current sample of the first frame, and determine a filter kernel used to obtain the second feature map corresponding to the modified difference map including the identified collocated sample, as a motion vector of the current sample.

公开(公告)号：US11694306B2

公开(公告)日：2023-07-04

申请号：US17240360

申请日：2021-04-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Sangwook Baek ,  Yongsup Park ,  Sangmi Lee ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T5/00 ,  G06T3/40 ,  G06N3/0464 ,  G06N3/045

CPC classification number: G06T5/001 ,  G06N3/045 ,  G06N3/0464 ,  G06T3/4046 ,  G06T3/4053 ,  G06T2207/20084

Abstract: An image processing apparatus for performing image quality processing on an image includes a feature extraction network and an image quality processing network including one or more modulation blocks, wherein each of the one or more modulation blocks includes a convolution layer, a modulation layer, and an activation layer for processing the image.

公开(公告)号：US11436703B2

公开(公告)日：2022-09-06

申请号：US17330809

申请日：2021-05-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T3/40 ,  H04N7/14 ,  G06T3/00 ,  H04N7/01

Abstract: Provided is a method of adaptively performing artificial intelligence (AI) downscaling on an image during a video telephone call of a user terminal. The method includes obtaining, from an opposite user terminal, AI upscaling support information of the opposite user terminal that is a target of a video telephone call, determining whether the user terminal is to perform AI downscaling on an original image, based on the AI upscaling support information, based on determining that the user terminal is to perform AI downscaling on the original image, obtaining a first image by AI downscaling the original image using a downscaling deep neural network (DNN), generating image data by performing first encoding on the first image, and transmitting AI data including information related to the AI downscaling and the image data.

公开(公告)号：US11223841B2

公开(公告)日：2022-01-11

申请号：US17333541

申请日：2021-05-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Youngo Park ,  Chaeeun Lee ,  Kwangpyo Choi

IPC: H04N19/00 ,  H04N19/44 ,  G06N3/04 ,  H04N19/85 ,  H04N19/124

Abstract: An artificial intelligence (AI) decoding apparatus includes at least one processor configured to execute one or more instructions to: obtain a second image corresponding to a first image by performing first decoding on image data included in a main bitstream, obtain AI upscaling activation flag information included in AI data of a sub-bitstream, determine whether to perform AI upscaling on the second image, based on the AI upscaling activation flag information, when it is determined that AI upscaling is to be performed on the second image, obtain a third image by performing AI upscaling on the second image, through an upscaling deep neural network (DNN) set according to upscaling DNN information, the upscaling DNN information selected from among a plurality of pieces of pre-stored upscaling DNN information based on at least a portion of the image data and/or at least a portion of AI sub-data.

公开(公告)号：US11138763B2

公开(公告)日：2021-10-05

申请号：US17082848

申请日：2020-10-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T9/00 ,  G06T3/40 ,  H04N19/85

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.

公开(公告)号：US11042965B2

公开(公告)日：2021-06-22

申请号：US17098907

申请日：2020-11-16

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo Park ,  Kwangpyo Choi ,  Yumi Sohn ,  Sungchan Kim ,  Myungjin Eom

IPC: G06T3/40 ,  G06N3/08 ,  G06T9/00 ,  H04N19/85

Abstract: Provided is a decoding apparatus including: a communication interface configured to receive AI encoding data generated as a result of artificial intelligence (AI) down-scaling and first encoding of an original image; a processor configured to divide the AI encoding data into image data and AI data; and an input/output (I/O) device, wherein the processor is further configured to: obtain a second image by performing first decoding on a first image obtained by performing AI down-scaling on the original image, based on the image data; and control the I/O device to transmit the second image and the AI data to an external apparatus. In some embodiments, the external apparatus performs an AI upscaling of the second image using the AI data, and displays the resulting third image.

公开(公告)号：US10937197B2

公开(公告)日：2021-03-02

申请号：US16821686

申请日：2020-03-17

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T9/00 ,  G06T3/40 ,  H04N19/85

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.

公开(公告)号：US10825206B2

公开(公告)日：2020-11-03

申请号：US16821609

申请日：2020-03-17

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T9/00 ,  G06T3/40 ,  H04N19/85

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.