公开(公告)号：US20240046590A1

公开(公告)日：2024-02-08

申请号：US18489390

申请日：2023-10-18

Applicant: Meta Platforms Technologies, LLC

Inventor： James Allan BOOTH ,  Gaurav CHAURASIA ,  Alexandru-Eugen ICHIM ,  Alex LOCHER ,  Gioacchino NORIS ,  Alexander Sorkine HORNUNG ,  Manuel WERLBERGER

IPC: G06T19/00 ,  G06T15/04 ,  G06T17/20

CPC classification number: G06T19/006 ,  G06T15/04 ,  G06T17/20

Abstract: A mixed reality (MR) simulation system includes a console and a head mounted device (HMD). The MR system captures stereoscopic images from a real-world environment using outward-facing stereoscopic cameras mounted to the HMD. The MR system preprocesses the stereoscopic images to maximize contrast and then extracts a set of features from those images, including edges or corners, among others. For each feature, the MR system generates one or more two-dimensional (2D) polylines. Then, the MR system triangulates between 2D polylines found in right side images and corresponding 2D polylines found in left side images to generate a set of 3D polylines. The MR system interpolates between 3D vertices included in the 3D polylines or extrapolates additional 3D vertices, thereby generating a geometric reconstruction of the real-world environment. The MR system may map textures derived from the real-world environment onto the geometric representation faster than the geometric reconstruction is updated.