公开(公告)号：US12229915B2

公开(公告)日：2025-02-18

申请号：US17895416

申请日：2022-08-25

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Youngo Park ,  Jongseok Lee ,  Chaeeun Lee ,  Kwangpyo Choi

IPC: G09G5/00 ,  G06T3/4046

Abstract: Provided is an electronic apparatus configured to provide an image based on artificial intelligence (AI), the electronic apparatus including a processor configured to execute one or more instructions stored in the electronic apparatus to obtain a first image by AI-downscaling an original image by a downscaling neural network, obtain first image data by encoding the first image, based on a display apparatus not supporting an AI upscaling function, obtain a second image by decoding the first image data, obtain a third image by AI-upscaling the second image by an upscaling neural network, and provide, to the display apparatus, second image data obtained by encoding the third image.

公开(公告)号：US20250054111A1

公开(公告)日：2025-02-13

申请号：US18929191

申请日：2024-10-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Yongsup Park ,  Sangwook Baek ,  Sangmi Lee ,  Youjin Lee ,  Taeyoung Jang ,  Gyehyun Kim ,  Beomseok Kim ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T5/60 ,  G06T3/4046

Abstract: Provided is an image processing method including upscaling an input image to generate an upscaled image, obtaining a first feature map and a second feature map by inputting the upscaled image to a convolutional neural network and performing a convolution operation on the upscaled image with one or more kernels included in the convolutional neural network, obtaining a gain map by inputting the first feature map to a first convolutional layer, obtaining an offset map by inputting the second feature map to a second convolutional layer, and generating an output image, based on the upscaled image, the gain map, and the offset map, wherein the convolutional neural network is configured to be trained to reduce a difference between a hue of the input image and a hue of the output image.

公开(公告)号：US12170786B2

公开(公告)日：2024-12-17

申请号：US18133369

申请日：2023-04-11

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Quockhanh Dinh ,  Kwangpyo Choi

IPC: G06T9/00 ,  H04N19/137 ,  H04N19/42 ,  H04N19/52

Abstract: An image decoding method includes obtaining feature data of a current optical flow and feature data of a current residual image from a bitstream; obtaining the current optical flow and first weight data by applying the feature data of the current optical flow to an optical flow decoder; obtaining the current residual image by applying the feature data of the current residual image to a residual decoder; obtaining a preliminary prediction image from the previous reconstructed image, based on the current optical flow; obtaining a final prediction image by applying sample values of the first weight data to sample values of the preliminary prediction image; and obtaining a current reconstructed image corresponding to the current image by combining the final prediction image with the current residual image.

公开(公告)号：US20240064331A1

公开(公告)日：2024-02-22

申请号：US18235612

申请日：2023-08-18

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Quockhanh DINH ,  Kyungah Kim ,  Minsoo Park ,  Minwoo Park ,  Kwangpyo Choi ,  Yinji Piao

IPC: H04N19/593 ,  H04N19/105 ,  H04N19/176 ,  H04N19/182 ,  H04N19/42

CPC classification number: H04N19/593 ,  H04N19/105 ,  H04N19/176 ,  H04N19/182 ,  H04N19/42

Abstract: An image decoding method and apparatus obtain intra prediction feature data of a current block from a bitstream, determine an intra flow indicating a reference pixel of a current pixel in the current block, by applying the intra prediction feature data, neighboring pixels of the current block, and coding context information of the current block to a neural network, obtain a predicted pixel of the current pixel based on the intra flow of the current block, and reconstruct the current block based on the predicted pixel.

公开(公告)号：US11863783B2

公开(公告)日：2024-01-02

申请号：US17677498

申请日：2022-02-22

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Quockhanh Dinh ,  Minwoo Park ,  Minsoo Park ,  Kwangpyo Choi

IPC: H04N19/51 ,  H04N19/137 ,  H04N19/124 ,  H04N19/43 ,  H04N19/91 ,  H04N19/17

CPC classification number: H04N19/51 ,  H04N19/124 ,  H04N19/137 ,  H04N19/17 ,  H04N19/43 ,  H04N19/91

Abstract: A method of reconstructing an optical flow by using artificial intelligence (AI), including obtaining, from a bitstream, feature data of a current residual optical flow for a current image; obtaining the current residual optical flow by applying the feature data of the current residual optical flow to a neural-network-based first decoder; obtaining a current predicted optical flow based on at least one of a previous optical flow, feature data of the previous optical flow, and feature data of a previous residual optical flow; and reconstructing a current optical flow based on the current residual optical flow and the current predicted optical flow.

公开(公告)号：US11688038B2

公开(公告)日：2023-06-27

申请号：US17575691

申请日：2022-01-14

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T3/40 ,  G06T9/00 ,  G06N3/084 ,  H04N19/85 ,  G06N20/10

CPC classification number: G06T3/4046 ,  G06N3/084 ,  G06N20/10 ,  G06T9/002 ,  H04N19/85 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: An artificial intelligence (AI) decoding apparatus includes a memory storing one or more instructions, and a processor configured to execute the stored one or more instructions, to obtain image data corresponding to a first image that is encoded, obtain a second image corresponding to the first image by decoding the obtained image data, determine whether to perform AI up-scaling of the obtained second image, based on the AI up-scaling of the obtained second image being determined to be performed, obtain a third image by performing the AI up-scaling of the obtained second image through an up-scaling deep neural network (DNN), and output the obtained third image, and based on the AI up-scaling of the obtained second image being determined to be not performed, output the obtained second image.

公开(公告)号：US20230030841A1

公开(公告)日：2023-02-02

申请号：US17967654

申请日：2022-10-17

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Woongil CHOI ,  Gahyun Ryu ,  Minsoo Park ,  Minwoo Park ,  Seungsoo Jeong ,  Kwangpyo Choi ,  Kiho Choi ,  Narae Choi ,  Anish Tamse ,  Yinji Piao

IPC: H04N19/174 ,  H04N19/172 ,  H04N19/119 ,  H04N19/105 ,  H04N19/70

Abstract: Provided is a video decoding method including obtaining identification information of a first tile and identification information of a last tile from a bitstream, wherein the first and last tiles are included in a first slice, determining an index difference between the first tile and the last tile, based on a result of comparing the identification information of the first tile with the identification information of the last tile, determining the number of tiles included in the first slice, by using the index difference between the first tile and the last tile, and decoding a plurality of tiles included in the first slice according to an encoding order by using the number of tiles included in the first slice, the identification information of the first tile, and the identification information of the last tile.

公开(公告)号：US11288770B2

公开(公告)日：2022-03-29

申请号：US17079773

申请日：2020-10-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T3/40 ,  G06T9/00 ,  G06N3/08 ,  H04N19/85 ,  G06N20/10

Abstract: An artificial intelligence (AI) decoding apparatus includes a memory storing one or more instructions, and a processor configured to execute the stored one or more instructions, to obtain image data corresponding to a first image that is encoded, obtain a second image corresponding to the first image by decoding the obtained image data, determine whether to perform AI up-scaling of the obtained second image, based on the AI up-scaling of the obtained second image being determined to be performed, obtain a third image by performing the AI up-scaling of the obtained second image through an up-scaling deep neural network (DNN), and output the obtained third image, and based on the AI up-scaling of the obtained second image being determined to be not performed, output the obtained second image.

公开(公告)号：US11170534B2

公开(公告)日：2021-11-09

申请号：US17082848

申请日：2020-10-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T9/00 ,  G06T3/40 ,  H04N19/85

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.

公开(公告)号：US11122267B2

公开(公告)日：2021-09-14

申请号：US16671286

申请日：2019-11-01

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Pilkyu Park ,  Kiljong Kim ,  Kwangpyo Choi

IPC: H04N19/124 ,  H04N19/196 ,  H04N19/119 ,  G06K9/62 ,  G06N3/08 ,  G06N20/10 ,  H04N19/176

Abstract: Provided is a method of encoding an image, the method including: obtaining a plurality of patches from the image; obtaining a plurality of transform coefficient groups respectively corresponding to the plurality of patches; inputting, to a machine learning model, input values corresponding to transform coefficients included in each of the plurality of transform coefficient groups; quantizing transform coefficients corresponding to the image by using a quantization table output from the machine learning model; and generating a bitstream including data generated as a result of the quantizing and information about the quantization table.