公开(公告)号：US20220101488A1

公开(公告)日：2022-03-31

申请号：US17429254

申请日：2019-02-21

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong Noh ,  Hanui Lee ,  Bumki Kim ,  Gukho Kim ,  Julie Alfonsine E. Lelong ,  Mohammad Reza Karimi Dastjerdi ,  Allen Kim ,  Jiwon Lee

IPC: G06T3/20 ,  G06T7/73 ,  G06K9/62 ,  G06V10/44 ,  G06V10/62 ,  G06V10/75 ,  G06T7/11

Abstract: An image processing device according to one embodiment estimates optical flow information, pixel by pixel, on the basis of a reference image and input images of consecutive frames, and estimates a term corresponding to temporal consistency between the frames of the input images. The image processing device determines a mesh on the basis of the term corresponding to temporal consistency and the optical flow information, and transforms the reference image on the basis of the mesh. The image processing device preforms image blending on the basis of the input image, the transformed reference image, and mask data.

公开(公告)号：US12190531B2

公开(公告)日：2025-01-07

申请号：US17424811

申请日：2019-02-21

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong Noh ,  Julie Alfonsine E. Lelong ,  Bumki Kim ,  Hanui Lee ,  Gukho Kim ,  Mohammad Reza Karimi Dastjerdi ,  Allen Kim ,  Jiwon Lee

IPC: G06K9/00 ,  G06T5/77 ,  G06T7/00 ,  G06T7/277

Abstract: An image processing device according to one embodiment estimates first optical flow information of a pixel unit on the basis of consecutive frames, and estimates a polynomial model corresponding to the optical flow information. The image processing device estimates second optical flow information of holes included in the frames on the basis of the polynomial model, and inpaints an input image on the basis of the first optical flow information and/or the second optical flow information.

公开(公告)号：US11893704B2

公开(公告)日：2024-02-06

申请号：US17429254

申请日：2019-02-21

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong Noh ,  Hanui Lee ,  Bumki Kim ,  Gukho Kim ,  Julie Alfonsine E. Lelong ,  Mohammad Reza Karimi Dastjerdi ,  Allen Kim ,  Jiwon Lee

IPC: G06T3/20 ,  G06T7/73 ,  G06T7/11 ,  G06V10/44 ,  G06V10/75 ,  G06V10/62 ,  G06F18/22 ,  G06F18/25

CPC classification number: G06T3/20 ,  G06F18/22 ,  G06F18/253 ,  G06T7/11 ,  G06T7/74 ,  G06V10/443 ,  G06V10/62 ,  G06V10/751 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20092 ,  G06T2207/20221

Abstract: An image processing device according to one embodiment estimates optical flow information, pixel by pixel, on the basis of a reference image and input images of consecutive frames, and estimates a term corresponding to temporal consistency between the frames of the input images. The image processing device determines a mesh on the basis of the term corresponding to temporal consistency and the optical flow information, and transforms the reference image on the basis of the mesh. The image processing device preforms image blending on the basis of the input image, the transformed reference image, and mask data.

公开(公告)号：US20220092796A1

公开(公告)日：2022-03-24

申请号：US17424811

申请日：2019-02-21

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong Noh ,  Julie Alfonsine E. Lelong ,  Bumki Kim ,  Hanui Lee ,  Gukho Kim ,  Mohammad Reza Karimi Dastjerdi ,  Allen Kim ,  Jiwon Lee

IPC: G06T7/277 ,  G06T7/00 ,  G06T5/00

Abstract: An image processing device according to one embodiment estimates first optical flow information of a pixel unit on the basis of consecutive frames, and estimates a polynomial model corresponding to the optical flow information. The image processing device estimates second optical flow information of holes included in the frames on the basis of the polynomial model, and inpaints an input image on the basis of the first optical flow information and/or the second optical flow information.