公开(公告)号：US20220284552A1

公开(公告)日：2022-09-08

申请号：US17192549

申请日：2021-03-04

Applicant: Lemon Inc.

Inventor： Linjie Yang ,  Ding Liu ,  Xueyan Zou

IPC: G06T5/00 ,  G06N3/08 ,  G06T3/00

Abstract: Systems and methods are directed to inpainting video. More specifically, initial video data including a sequence of image frames containing missing or corrupted pixel information may be received. Optical flow displacement values and optical flow validity masks may be generated for neighboring image frames of initial video data. Image features from image feature maps of one or more neighboring image frames may be warp-shifted to image feature maps of a current image frame using the optical flow displacement values and warp-shifted image features from the feature maps of the one or more neighboring image frames may be selected based on one or more of the optical flow validity masks. A sequence of complete image frames may be generated based on the selected warp-shifted image features from the feature maps of the one or more neighboring image frames and image features from the image feature maps of the current image frame.

公开(公告)号：US11625814B2

公开(公告)日：2023-04-11

申请号：US17192549

申请日：2021-03-04

Applicant: Lemon Inc.

Inventor： Linjie Yang ,  Ding Liu ,  Xueyan Zou

IPC: G06K9/00 ,  G06T5/00 ,  G06N3/08 ,  G06T3/00

Abstract: Systems and methods are directed to inpainting video. More specifically, initial video data including a sequence of image frames containing missing or corrupted pixel information may be received. Optical flow displacement values and optical flow validity masks may be generated for neighboring image frames of initial video data. Image features from image feature maps of one or more neighboring image frames may be warp-shifted to image feature maps of a current image frame using the optical flow displacement values and warp-shifted image features from the feature maps of the one or more neighboring image frames may be selected based on one or more of the optical flow validity masks. A sequence of complete image frames may be generated based on the selected warp-shifted image features from the feature maps of the one or more neighboring image frames and image features from the image feature maps of the current image frame.