公开(公告)号：US12182918B2

公开(公告)日：2024-12-31

申请号：US17847472

申请日：2022-06-23

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong Noh ,  Ha Young Chang ,  Kwanggyoon Seo ,  Jung Eun Yoo

IPC: G06T13/20 ,  G06T7/194

Abstract: A method of training a deep neural network for generating a cinemagraph is disclosed. The method may include preparing a foreground layer input by using an input video, preparing a background layer input by using the input video, providing a foreground layer output and a background layer output from the DNN by inputting, to the DNN, the foreground layer input and the background layer input, providing an output video by synthesizing the foreground layer output with the background layer output, and updating intrinsic parameters of the DNN a plurality of times, based on the input video, the foreground layer input, the foreground layer output, the background layer output, and the output video.

公开(公告)号：US11900607B2

公开(公告)日：2024-02-13

申请号：US17743448

申请日：2022-05-13

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong Noh ,  Jung Eun Yoo ,  Kwanggyoon Seo ,  Sanghun Park ,  Jaedong Kim ,  Dawon Lee

IPC: G06T7/11 ,  G06T7/62 ,  G06T15/20

CPC classification number: G06T7/11 ,  G06T7/62 ,  G06T15/205

Abstract: Provided is a method of framing a three dimensional (3D) target object for generation of a virtual camera layout. The method may include analyzing a reference video image to extract a framing rule for at least one reference object in the reference video image, generating a framing rule for at least one 3D target object using the framing rule for the at least one reference object in the reference video image, and using the framing rule for the at least one 3D target object for generation of a virtual camera layout.

公开(公告)号：US11790486B2

公开(公告)日：2023-10-17

申请号：US17444919

申请日：2021-08-12

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong Noh ,  Sanghun Park ,  Kwanggyoon Seo

IPC: G06K9/00 ,  G06T3/40 ,  G06T5/50 ,  G06N3/088 ,  G06N3/045

CPC classification number: G06T3/4007 ,  G06N3/045 ,  G06N3/088 ,  G06T3/4046 ,  G06T5/50 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Disclosed is an image processing method and apparatus. The image processing method includes extracting a content latent code and a style latent code for each of a plurality of input images, obtaining a content feature vector by calculating a weighted sum of content latent codes extracted from the input images based on a morphing control parameter, obtaining a style feature vector by calculating a weighted sum of style latent codes extracted from the input images based on the morphing control parameter, and generating a morphing image based on the content feature vector and the style feature vector.

公开(公告)号：US20230410249A1

公开(公告)日：2023-12-21

申请号：US18457499

申请日：2023-08-29

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong Noh ,  Sanghun Park ,  Kwanggyoon Seo

IPC: G06T3/40 ,  G06T5/50 ,  G06N3/088 ,  G06N3/045

CPC classification number: G06T3/4007 ,  G06T3/4046 ,  G06T5/50 ,  G06N3/088 ,  G06N3/045 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Disclosed is an image processing method and apparatus. The image processing method includes extracting a content latent code and a style latent code for each of a plurality of input images, obtaining a content feature vector by calculating a weighted sum of content latent codes extracted from the input images based on a morphing control parameter, obtaining a style feature vector by calculating a weighted sum of style latent codes extracted from the input images based on the morphing control parameter, and generating a morphing image based on the content feature vector and the style feature vector.

公开(公告)号：US20220164921A1

公开(公告)日：2022-05-26

申请号：US17444919

申请日：2021-08-12

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong Noh ,  Sanghun Park ,  Kwanggyoon Seo

IPC: G06T3/40 ,  G06T5/50 ,  G06N3/08 ,  G06N3/04

Abstract: Disclosed is an image processing method and apparatus. The image processing method includes extracting a content latent code and a style latent code for each of a plurality of input images, obtaining a content feature vector by calculating a weighted sum of content latent codes extracted from the input images based on a morphing control parameter, obtaining a style feature vector by calculating a weighted sum of style latent codes extracted from the input images based on the morphing control parameter, and generating a morphing image based on the content feature vector and the style feature vector.

公开(公告)号：US11887330B2

公开(公告)日：2024-01-30

申请号：US17848813

申请日：2022-06-24

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong Noh ,  Hyunggoog Seo ,  Jaedong Kim ,  Kwanggyoon Seo ,  Bumki Kim

IPC: G06T7/73 ,  G06F3/01 ,  G06F3/03 ,  G06F3/0484

CPC classification number: G06T7/73 ,  G06F3/012 ,  G06F3/017 ,  G06F3/03 ,  G06F3/0484

Abstract: A method of assisting object registration in a smart home system including a plurality of objects is disclosed. The disclosed method may include allowing a user to select an object from among a plurality of objects, capturing a plurality of pointing gestures by allowing the user to perform the plurality of pointing gestures at the selected object, configuring a pointing ray using each of the plurality of captured pointing gestures, estimating a position of a nearest point extending from the plurality of pointing rays, and registering the estimated position of the nearest point as a position of the selected object.