公开(公告)号：US11694306B2

公开(公告)日：2023-07-04

申请号：US17240360

申请日：2021-04-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Sangwook Baek ,  Yongsup Park ,  Sangmi Lee ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T5/00 ,  G06T3/40 ,  G06N3/0464 ,  G06N3/045

CPC classification number: G06T5/001 ,  G06N3/045 ,  G06N3/0464 ,  G06T3/4046 ,  G06T3/4053 ,  G06T2207/20084

Abstract: An image processing apparatus for performing image quality processing on an image includes a feature extraction network and an image quality processing network including one or more modulation blocks, wherein each of the one or more modulation blocks includes a convolution layer, a modulation layer, and an activation layer for processing the image.

公开(公告)号：US11516483B2

公开(公告)日：2022-11-29

申请号：US17299193

申请日：2019-12-09

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Woongil Choi ,  Gahyun Ryu ,  Minsoo Park ,  Minwoo Park ,  Seungsoo Jeong ,  Kwangpyo Choi ,  Kiho Choi ,  Narae Choi ,  Anish Tamse ,  Yinji Piao

IPC: H04N19/174 ,  H04N19/105 ,  H04N19/119 ,  H04N19/172 ,  H04N19/70

Abstract: Provided is a video decoding method including obtaining identification information of a first tile and identification information of a last tile from a bitstream, wherein the first and last tiles are included in a first slice, determining an index difference between the first tile and the last tile, based on a result of comparing the identification information of the first tile with the identification information of the last tile, determining the number of tiles included in the first slice, by using the index difference between the first tile and the last tile, and decoding a plurality of tiles included in the first slice according to an encoding order by using the number of tiles included in the first slice, the identification information of the first tile, and the identification information of the last tile.

公开(公告)号：US11436703B2

公开(公告)日：2022-09-06

申请号：US17330809

申请日：2021-05-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T3/40 ,  H04N7/14 ,  G06T3/00 ,  H04N7/01

Abstract: Provided is a method of adaptively performing artificial intelligence (AI) downscaling on an image during a video telephone call of a user terminal. The method includes obtaining, from an opposite user terminal, AI upscaling support information of the opposite user terminal that is a target of a video telephone call, determining whether the user terminal is to perform AI downscaling on an original image, based on the AI upscaling support information, based on determining that the user terminal is to perform AI downscaling on the original image, obtaining a first image by AI downscaling the original image using a downscaling deep neural network (DNN), generating image data by performing first encoding on the first image, and transmitting AI data including information related to the AI downscaling and the image data.

公开(公告)号：US11380081B2

公开(公告)日：2022-07-05

申请号：US16861428

申请日：2020-04-29

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaeyeon Park ,  Yongsup Park ,  Iljun Ahn ,  Sangwook Baek ,  Minsu Cheon ,  Kwangpyo Choi

IPC: G06V10/40 ,  G06K9/62 ,  G06N3/08 ,  G06T5/20

Abstract: Provided is an image processing apparatus including a memory storing at least one instruction, and a processor configured to execute the at least one instruction stored in the memory to obtain first feature information by performing a convolution operation on a first image and a first kernel included in a first convolution layer among a plurality of convolution layers, obtain at least one piece of characteristic information, based on the first feature information; obtain second feature information, based on the first feature information and the at least one piece of characteristic information, obtain third feature information by performing a convolution operation on the obtained second feature information and a second kernel included in a second convolution layer that is a layer next to the first convolution layer among the plurality of convolution layers, and obtain an output image, based on the third feature information.

公开(公告)号：US11272209B2

公开(公告)日：2022-03-08

申请号：US16970564

申请日：2019-04-03

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Ramkumaar KK ,  Sri Nitchith Akula ,  Chirag Mahesh Kumar Pujara ,  Anubhav Singh ,  Akhil Konda ,  Raj Narayana Gadde ,  Amith Dsouza ,  Nishant Sharma ,  Kwangpyo Choi ,  Woongil Choi

IPC: H04N19/597 ,  H04N19/14 ,  H04N13/139 ,  H04N13/10

Abstract: Provided are methods and apparatus for determining an adjustment parameter during encoding of a spherical multimedia content which comprises finding the region of maximum concentrated energy is concentrated in the generated energy map of the spherical multimedia content, measuring the width of the maximum concentrated energy region in the generated energy map, and deriving optimal adjustment parameter from the width of the maximum concentrated energy region in the generated energy map.

公开(公告)号：US11223841B2

公开(公告)日：2022-01-11

申请号：US17333541

申请日：2021-05-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Youngo Park ,  Chaeeun Lee ,  Kwangpyo Choi

IPC: H04N19/00 ,  H04N19/44 ,  G06N3/04 ,  H04N19/85 ,  H04N19/124

Abstract: An artificial intelligence (AI) decoding apparatus includes at least one processor configured to execute one or more instructions to: obtain a second image corresponding to a first image by performing first decoding on image data included in a main bitstream, obtain AI upscaling activation flag information included in AI data of a sub-bitstream, determine whether to perform AI upscaling on the second image, based on the AI upscaling activation flag information, when it is determined that AI upscaling is to be performed on the second image, obtain a third image by performing AI upscaling on the second image, through an upscaling deep neural network (DNN) set according to upscaling DNN information, the upscaling DNN information selected from among a plurality of pieces of pre-stored upscaling DNN information based on at least a portion of the image data and/or at least a portion of AI sub-data.

公开(公告)号：US11138763B2

公开(公告)日：2021-10-05

申请号：US17082848

申请日：2020-10-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T9/00 ,  G06T3/40 ,  H04N19/85

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.

公开(公告)号：US11042965B2

公开(公告)日：2021-06-22

申请号：US17098907

申请日：2020-11-16

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo Park ,  Kwangpyo Choi ,  Yumi Sohn ,  Sungchan Kim ,  Myungjin Eom

IPC: G06T3/40 ,  G06N3/08 ,  G06T9/00 ,  H04N19/85

Abstract: Provided is a decoding apparatus including: a communication interface configured to receive AI encoding data generated as a result of artificial intelligence (AI) down-scaling and first encoding of an original image; a processor configured to divide the AI encoding data into image data and AI data; and an input/output (I/O) device, wherein the processor is further configured to: obtain a second image by performing first decoding on a first image obtained by performing AI down-scaling on the original image, based on the image data; and control the I/O device to transmit the second image and the AI data to an external apparatus. In some embodiments, the external apparatus performs an AI upscaling of the second image using the AI data, and displays the resulting third image.

公开(公告)号：US10950009B2

公开(公告)日：2021-03-16

申请号：US16743618

申请日：2020-01-15

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Quockhanh Dinh ,  Minseok Choi ,  Kwangpyo Choi

IPC: G06T9/00 ,  G06T3/40 ,  G06K9/62 ,  H04N19/85 ,  G06N3/02

Abstract: Provided is an artificial intelligence (AI) decoding apparatus including a memory storing one or more instructions; and a processor configured to execute the one or more instructions to, when an image is input to a second DNN including a plurality of layers, obtain first result values based on an operation between the image and a first filter kernel and obtain second result values based on an operation between the image and a second filter kernel, from a first layer including the first and second filter kernels from among the plurality of layers, perform normalization by transforming the first result values into first values by using a first scale factor, and, perform normalization by transforming the second result values into second values by using a second scale factor, transform the first values and the second values into integer values included in a preset range.

公开(公告)号：US10937197B2

公开(公告)日：2021-03-02

申请号：US16821686

申请日：2020-03-17

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T9/00 ,  G06T3/40 ,  H04N19/85

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.