公开(公告)号：US20250069334A1

公开(公告)日：2025-02-27

申请号：US18454349

申请日：2023-08-23

Applicant: Meta Platforms Technologies, LLC

Inventor： Sony NGUYEN ,  Justin STRAWN ,  Eric LEUNG ,  Marc KREJCI ,  Benjamin XU ,  Samuel MCGAREY ,  Muqing NIU ,  Sierra DEAN ,  Jianhan XU ,  Ran ZHANG ,  Lu ZHOU ,  Audrey Muller ,  Matthew Banks ,  Sabrina Zhai

IPC: G06T19/00

Abstract: Aspects of the present disclosure are directed to providing assisted scene capture for an artificial reality (XR) environment. Some implementations can obtain an XR space model corresponding to a real-world space, including walls, the ceiling, and the floor, using an XR system. Some implementations can then scan the real-world space and display a mesh corresponding to the scanned area overlaid onto a view of the real-world space. Some implementations can perform post-processing on the displayed mesh, which can include A) collapsing variations in the mesh corresponding to the walls, ceiling, or floor onto the XR space model; B) clipping the mesh to the XR space model for open doorways, windows, etc.; C) simplifying the mesh corresponding to the walls, ceiling, or floor; D) determining that the mesh is complete by identifying that a threshold percentage of the XR space model is covered by the mesh; or any combination thereof.

公开(公告)号：US20250104366A1

公开(公告)日：2025-03-27

申请号：US18810209

申请日：2024-08-20

Applicant: Meta Platforms Technologies, LLC

Inventor： Biju MATHEW ,  Christopher Richard TANNER ,  Jianhan XU ,  Wenxin XU ,  Shen LI ,  Peter JU ,  James Alexander VALORI ,  Eric LEUNG ,  Lu ZHOU

IPC: G06T19/00 ,  G06V20/20

Abstract: Instead of having a constant boundary, artificial reality (XR) applications that can run in boundaryless mode (e.g., in augmented or mixed reality) can be given controls by selective boundary system on an XR system to customize partial boundaries. For example, an application can specify to select particular boundaries when certain object types are in the real-world environment. In another example, an application can transition to different boundary modes when certain application events occur (e.g., when transitioning from virtual reality to mixed reality). On the backend, the selective boundary system can provide the application with an API that exposes boundary information. Based on this information, the application can use the API to create new boundaries or turn on or off certain boundaries based on requests by the application.

公开(公告)号：US20250104365A1

公开(公告)日：2025-03-27

申请号：US18771009

申请日：2024-07-12

Applicant: Meta Platforms Technologies, LLC

Inventor： Asaf NITZAN ,  Ariana Yu-Chia HARVEY ,  Jasmine OU ,  Ting Ting WU ,  Christopher Richard TANNER ,  Muqing NIU ,  Peter JU ,  Eric LEUNG ,  James Alexander VALORI ,  Michael CASTILLO ,  Adi PERRY ,  Dan KLARMAN ,  Einav Namer YELIN ,  Tal Haim Ben BASAT ,  Jeremie GUEDJ ,  Alon LERNER ,  Savitha Yalanadu SHIVAIAH

IPC: G06T19/00 ,  G06T7/13 ,  G06T7/60 ,  G06T19/20

Abstract: For artificial reality (XR) applications that need a guardian, aspects of the present disclosure can automatically determine where boundaries should be set in the real-world environment. Using a machine learning model, the automatic boundary system can detect the floor plane, then generate a height map of the real-world environment with the floor at zero. The height map can include positive heights (e.g., objects on the floor) and negative heights (e.g., downward leading stairs). The automatic boundary system can then generate a boundary for the area based on the detected heights by: applying thresholds to disregard objects at certain heights, applying thresholds to disregard open areas at certain widths, excluding oddly shaped areas that would constantly trigger the boundary if the user were nearby, etc. The user can further manually adjust the generated boundary in both directions (e.g., bringing it closer or further from the user).