公开(公告)号：US20230074023A1

公开(公告)日：2023-03-09

申请号：US17876043

申请日：2022-07-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jongseok LEE ,  Youngo PARK ,  Pilkyu PARK ,  Yumi SOHN

IPC: H04N19/59 ,  H04N19/61 ,  H04N19/172 ,  G06T3/40 ,  G06N3/04

Abstract: Methods and apparatuses for image encoding and image decoding are provided. The image decoding method includes: obtaining deep neural network (DNN) update permission information indicating whether one or more pieces of DNN setting information are updated; based on the DNN update permission information indicating that the one or more pieces of the DNN setting information are updated, obtaining DNN update information necessary for determining one or more pieces of the DNN setting information that are updated; determining the one or more pieces of the updated DNN setting information according to the DNN update information; and obtaining a third image by performing artificial intelligence (AI) up-scaling on a second image according to the one or more pieces of the updated DNN setting information.

公开(公告)号：US20220028121A1

公开(公告)日：2022-01-27

申请号：US17495050

申请日：2021-10-06

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jongseok LEE ,  Jaehwan KIM ,  Youngo PARK

IPC: G06T9/00 ,  G06N3/08 ,  G06T3/40

Abstract: An artificial intelligence (AI) decoding method including obtaining image data generated from performing first encoding on a first image and AI data related to AI down-scaling of at least one original image related to the first image; obtaining a second image corresponding to the first image by performing first decoding on the image data; obtaining, based on the AI data, deep neural network (DNN) setting information for performing AI up-scaling of the second image; and generating a third image by performing the AI up-scaling on the second image via an up-scaling DNN operating according to the obtained DNN setting information. The DNN setting information is DNN information updated for performing the AI up-scaling of at least one second image via joint training of the up-scaling DNN and a down-scaling DNN used for the AI down-scaling.

公开(公告)号：US20210176490A1

公开(公告)日：2021-06-10

申请号：US17181744

申请日：2021-02-22

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jongseok LEE ,  Youngo PARK ,  Pilkyu PARK ,  Yumi SOHN

IPC: H04N19/59 ,  H04N19/61 ,  G06T3/40 ,  H04N19/172 ,  G06N3/04

Abstract: Methods and apparatuses for image encoding and image decoding are provided. The image decoding method includes: obtaining deep neural network (DNN) update permission information indicating whether one or more pieces of DNN setting information are updated; based on the DNN update permission information indicating that the one or more pieces of the DNN setting information are updated, obtaining DNN update information necessary for determining one or more pieces of the DNN setting information that are updated; determining the one or more pieces of the updated DNN setting information according to the DNN update information; and obtaining a third image by performing artificial intelligence (AI) up-scaling on a second image according to the one or more pieces of the updated DNN setting information.

公开(公告)号：US20210125380A1

公开(公告)日：2021-04-29

申请号：US17082442

申请日：2020-10-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jongseok LEE ,  Jaehwan KIM ,  Youngo PARK

IPC: G06T9/00 ,  G06T3/40 ,  G06N3/08

Abstract: An artificial intelligence (AI) decoding method including obtaining image data generated from performing first encoding on a first image and AI data related to AI down-scaling of at least one original image related to the first image; obtaining a second image corresponding to the first image by performing first decoding on the image data; obtaining, based on the AI data, deep neural network (DNN) setting information for performing AI up-scaling of the second image; and generating a third image by performing the AI up-scaling on the second image via an up-scaling DNN operating according to the obtained DNN setting information. The DNN setting information is DNN information updated for performing the AI up-scaling of at least one second image via joint training of the up-scaling DNN and a down-scaling DNN used for the AI down-scaling.

公开(公告)号：US20210118189A1

公开(公告)日：2021-04-22

申请号：US17082848

申请日：2020-10-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan KIM ,  Jongseok LEE ,  Sunyoung JEON ,  Kwangpyo CHOI ,  Minseok CHOI ,  Quockhanh DINH ,  Youngo PARK

IPC: G06T9/00 ,  G06T3/40 ,  H04N19/85

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.

公开(公告)号：US20210044813A1

公开(公告)日：2021-02-11

申请号：US17080827

申请日：2020-10-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Pilkyu PARK ,  Youngo PARK ,  Jongseok LEE ,  Yumi SOHN ,  Myungjin EOM

IPC: H04N19/30 ,  H04N19/172 ,  H04N19/70 ,  H04N19/42 ,  H04N19/146

Abstract: Provided is a computer-recordable recording medium having stored thereon a video file including artificial intelligence (AI) encoding data, wherein the AI encoding data includes: image data including encoding information of a low resolution image generated by AI down-scaling a high resolution image; and AI data about AI up-scaling of the low resolution image reconstructed according to the image data, wherein the AI data includes: AI target data indicating whether AI up-scaling is to be applied to at least one frame; and AI supplementary data about up-scaling deep neural network (DNN) information used for AI up-scaling of the at least one frame from among a plurality of pieces of pre-set default DNN configuration information, when AI up-scaling is applied to the at least one frame.

公开(公告)号：US20200260093A1

公开(公告)日：2020-08-13

申请号：US16860563

申请日：2020-04-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Pilkyu PARK ,  Youngo PARK ,  Jongseok LEE ,  Yumi SOHN ,  Myungjin EOM

IPC: H04N19/30 ,  H04N19/146 ,  H04N19/70 ,  H04N19/42 ,  H04N19/172

Abstract: Provided is a computer-recordable recording medium having stored thereon a video file including artificial intelligence (AI) encoding data, wherein the AI encoding data includes: image data including encoding information of a low resolution image generated by AI down-scaling a high resolution image; and AI data about AI up-scaling of the low resolution image reconstructed according to the image data, wherein the AI data includes: AI target data indicating whether AI up-scaling is to be applied to at least one frame; and AI supplementary data about up-scaling deep neural network (DNN) information used for AI up-scaling of the at least one frame from among a plurality of pieces of pre-set default DNN configuration information, when AI up-scaling is applied to the at least one frame.

公开(公告)号：US20200175650A1

公开(公告)日：2020-06-04

申请号：US16781083

申请日：2020-02-04

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan KIM ,  Jongseok LEE ,  Sunyoung JEON ,  Kwangpyo CHOI ,  Minseok CHOI ,  Quockhanh DINH ,  Youngo PARK

IPC: G06T3/40 ,  G06T7/00 ,  G06T9/00 ,  G06N3/08 ,  G06N20/10

Abstract: An artificial intelligence (AI) decoding apparatus includes a memory storing one or more instructions, and a processor configured to execute the stored one or more instructions, to obtain image data corresponding to a first image that is encoded, obtain a second image corresponding to the first image by decoding the obtained image data, determine whether to perform AI up-scaling of the obtained second image, based on the AI up-scaling of the obtained second image being determined to be performed, obtain a third image by performing the AI up-scaling of the obtained second image through an up-scaling deep neural network (DNN), and output the obtained third image, and based on the AI up-scaling of the obtained second image being determined to be not performed, output the obtained second image.

公开(公告)号：US20200126262A1

公开(公告)日：2020-04-23

申请号：US16570057

申请日：2019-09-13

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan KIM ,  Jongseok LEE ,  Sunyoung JEON ,  Kwangpyo CHOI ,  Minseok CHOI ,  Quockhanh DINH ,  Youngo PARK

IPC: G06T9/00 ,  G06T3/40

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.

公开(公告)号：US20200126186A1

公开(公告)日：2020-04-23

申请号：US16656812

申请日：2019-10-18

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan KIM ,  Jongseok LEE ,  Sunyoung JEON ,  Kwangpyo CHOI ,  Minseok CHOI ,  Quockhanh DINH ,  Youngo PARK

IPC: G06T3/40 ,  G06T9/00 ,  G06T7/00 ,  G06N3/08 ,  G06N20/10

Abstract: An artificial intelligence (AI) decoding apparatus includes a memory storing one or more instructions, and a processor configured to execute the stored one or more instructions, to obtain image data corresponding to a first image that is encoded, obtain a second image corresponding to the first image by decoding the obtained image data, determine whether to perform AI up-scaling of the obtained second image, based on the AI up-scaling of the obtained second image being determined to be performed, obtain a third image by performing the AI up-scaling of the obtained second image through an up-scaling deep neural network (DNN), and output the obtained third image, and based on the AI up-scaling of the obtained second image being determined to be not performed, output the obtained second image.