公开(公告)号：US20200250436A1

公开(公告)日：2020-08-06

申请号：US16856292

申请日：2020-04-23

Applicant: Adobe Inc.

Inventor： Joon-Young Lee ,  Seoungwug Oh ,  Kalyan Krishna Sunkavalli

IPC: G06K9/00 ,  G06T7/155 ,  G06K9/62 ,  G06T9/00

Abstract: Various embodiments describe video object segmentation using a neural network and the training of the neural network. The neural network both detects a target object in the current frame based on a reference frame and a reference mask that define the target object and propagates the segmentation mask of the target object for a previous frame to the current frame to generate a segmentation mask for the current frame. In some embodiments, the neural network is pre-trained using synthetically generated static training images and is then fine-tuned using training videos.

公开(公告)号：US10600239B2

公开(公告)日：2020-03-24

申请号：US15877142

申请日：2018-01-22

Applicant: ADOBE INC.

Inventor： Jeong Joon Park ,  Zhili Chen ,  Xin Sun ,  Vladimir Kim ,  Kalyan Krishna Sunkavalli ,  Duygu Ceylan Aksit

IPC: G06T15/50 ,  G06T19/00 ,  G06T15/60

Abstract: Matching an illumination of an embedded virtual object (VO) with current environment illumination conditions provides an enhanced immersive experience to a user. To match the VO and environment illuminations, illumination basis functions are determined based on preprocessing image data, captured as a first combination of intensities of direct illumination sources illuminates the environment. Each basis function corresponds to one of the direct illumination sources. During the capture of runtime image data, a second combination of intensities illuminates the environment. An illumination-weighting vector is determined based on the runtime image data. The determination of the weighting vector accounts for indirect illumination sources, such as surface reflections. The weighting vector encodes a superposition of the basis functions that corresponds to the second combination of intensities. The method illuminates the VO based on the weighting vector. The resulting illumination of the VO matches the second combination of the intensities and surface reflections.