公开(公告)号：US20230260222A1

公开(公告)日：2023-08-17

申请号：US18087483

申请日：2022-12-22

Applicant: Meta Platforms Technologies, LLC

Inventor： Brevin Tilmon ,  Shuochen Su ,  Michael Hall

IPC: G06T19/00 ,  G06V10/74 ,  H04N13/128 ,  G01S17/89

CPC classification number: G06T19/006 ,  G06V10/761 ,  H04N13/128 ,  G01S17/89 ,  H04N2013/0081

Abstract: A binary depth mask model is trained for use in occlusion within a mixed reality application. The training leverages information about virtual object positions and depths that is inherently available to the system as part of rendering of virtual objects. Training is performed on a set of stereo images, a set of binary depth masks corresponding to the stereo images, and a depth value against which object depth is evaluated. Given this input, the training outputs the binary depth mask model, which when given a stereo image as input outputs a depth binary depth mask indicating which pixels of the stereo image are nearer, or father away, than the depth value. The depth mask model can be applied in real time to handle occlusion operations when compositing a given real-world stereo image with virtual objects.