公开(公告)号：US20240071035A1

公开(公告)日：2024-02-29

申请号：US18112822

申请日：2023-02-22

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Stavros TSOGKAS ,  Fengjia ZHANG ,  Aleksai LEVINSHTEIN ,  Allen Douglas JEPSON

IPC: G06V10/26 ,  G06T5/00 ,  G06T7/215 ,  G06T7/254 ,  G06T7/38 ,  G06V10/77 ,  G06V20/40

CPC classification number: G06V10/273 ,  G06T5/005 ,  G06T7/215 ,  G06T7/254 ,  G06T7/38 ,  G06V10/7715 ,  G06V20/46 ,  G06T2207/20221

Abstract: The present disclosure provides methods, apparatuses, and computer-readable mediums for performing multi-frame de-fencing by a device. In some embodiments, a method includes obtaining an image burst having at least one portion of a background scene obstructed by an opaque obstruction. The method further includes generating a plurality of obstruction masks marking the at least one portion of the background scene obstructed by the opaque obstruction in images of the image burst. The method further includes computing a motion of the background scene, with respect to a keyframe selected from the plurality of images, by applying an occlusion-aware optical flow model. The method further includes reconstructing the selected keyframe by providing a combination of features to an image fusion and inpainting network. The method further includes providing, to the user, the reconstructed keyframe comprising an unobstructed version of the background scene of the image burst.