公开(公告)号：US20240265656A1

公开(公告)日：2024-08-08

申请号：US18166144

申请日：2023-02-08

Applicant: Meta Platforms Technologies, LLC

Inventor： Anastasia VICTOR-FAICHNEY ,  Matthew Alan INSLEY ,  Samuel Matthew LEVATICH ,  Ahad Habib BASRAVI ,  Matthew LUTHER ,  Andrew C. JOHNSON ,  Matthaeus KRENN ,  Difei WANG ,  Irvi STEFO ,  Norah Riley SMITH

IPC: G06T19/20 ,  G06F3/01

CPC classification number: G06T19/20 ,  G06F3/014 ,  G06T2219/2016

Abstract: A computer implemented method for facilitating system user interface (UI) interactions in an artificial reality (XR) environment is provided. The method includes rendering the system UI in the XR environment as a 3D virtual element. The method further includes tracking a position of a hand of a user and a pre-defined stable point on the user. The method further includes identifying, based on the tracking, that the hand has grasped a portion of the system UI and, in response, rotating the position of the system UI around the grasped portion of the system UI such that a line, between the stable point and the surface of the system UI, is moved, to be perpendicular or at a predefined angle from perpendicular to the surface of the system UI, as the user moves the system UI via the grasped portion.

公开(公告)号：US20240264660A1

公开(公告)日：2024-08-08

申请号：US18166282

申请日：2023-02-08

Applicant: Meta Platforms Technologies, LLC

Inventor： Samuel Matthew LEVATICH ,  Matthew Alan INSLEY ,  Andrew C. JOHNSON ,  Qi XIONG ,  Jeremy EDELBLUT ,  Matthaeus KRENN ,  John Nicholas JITKOFF ,  Jennifer MORROW ,  Brandon FURTWANGLER

IPC: G06F3/01 ,  G06F3/16

CPC classification number: G06F3/011 ,  G06F3/017 ,  G06F3/167

Abstract: A computer implemented method for facilitating user interface interactions in an XR environment is provided. The method incudes rendering a system UI and tracking a position of user's hand. The method further includes signifying an interaction opportunity by generating first feedback that modifies a UI element based on position of user's hand being within first threshold distance of the UI element or by generating second feedback that accentuates an edge of the system UI based on the position of user's hand being within second threshold distance of the edge. Furthermore, the method includes updating the position of the user's hand. The method further includes signifying interaction with the UI element by modifying location of representation of the user's hand, when the user's hand has interacted with the UI element or signifying interaction with the edge by generating third feedback that accentuates the portion of the representation that grabs the edge.

公开(公告)号：US20230326144A1

公开(公告)日：2023-10-12

申请号：US17716141

申请日：2022-04-08

Applicant: Meta Platforms Technologies, LLC

Inventor： Matthew Alan INSLEY

IPC: G06T19/00 ,  G06F3/04815 ,  G06F3/01

CPC classification number: G06T19/006 ,  G06F3/04815 ,  G06F3/017

Abstract: Aspects of the present disclosure are directed to triggering object transitions between near-field and far-field regions in an artificial reality environment. For example, the near-field region can be within arm's length for the user, while the far-field region can be greater than arm's length from the user. Objects can be displayed within these regions such that the user can interact with the objects in the artificial reality environment. A field manager can cause a displayed object to transition from the near-field region to the far-field region and/or from the far-field region to the near-field region. The field manager can compare sensed user movements to one or more trigger criteria (e.g., distance threshold(s), velocity threshold(s), etc.) to trigger transition of an object between field regions.

公开(公告)号：US20240273840A1

公开(公告)日：2024-08-15

申请号：US18635490

申请日：2024-04-15

Applicant: Meta Platforms Technologies, LLC

Inventor： Norah Riley SMITH ,  Matthew Alan INSLEY

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/04815

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06F3/017 ,  G06F3/04815

Abstract: A wrist-pose isolation system can infer a wrist pose (e.g., the user's hand position relative to her forearm) and can reduce wrist-induced jitter for projection casting in an XR environment. A user's projection cast can be determined as a combination of a “low-wrist contribution” component (e.g., a body-and-arm component) and a “high-wrist contribution” component (e.g., the pose of the wrist with respect to the arm). Using input from a gesture-tracking system, the contribution of the user's wrist pose to the user's current projection cast is calculated as a “wrist-contribution vector.” A projection cast direction can be determined as the interpolation of the current low-wrist contribution component and the high-wrist contribution component. This interpolation can be performed by weighting each by a specified amount and combining them.

公开(公告)号：US20230326150A1

公开(公告)日：2023-10-12

申请号：US18182417

申请日：2023-03-13

Applicant: Meta Platforms Technologies, LLC

Inventor： Norah Riley SMITH ,  Matthew Alan INSLEY

IPC: G06T19/00 ,  G06F3/04815 ,  G06F3/01

CPC classification number: G06T19/006 ,  G06F3/04815 ,  G06F3/017 ,  G06F3/011

Abstract: A wrist-pose isolation system can infer a wrist pose (e.g., the user's hand position relative to her forearm) and can reduce wrist-induced jitter for projection casting in an XR environment. A user's projection cast can be determined as a combination of a “low-wrist contribution” component (e.g., a body-and-arm component) and a “high-wrist contribution” component (e.g., the pose of the wrist with respect to the arm). Using input from a gesture-tracking system, the contribution of the user's wrist pose to the user's current projection cast is calculated as a “wrist-contribution vector.” A projection cast direction can be determined as the interpolation of the current low-wrist contribution component and the high-wrist contribution component. This interpolation can be performed by weighting each by a specified amount and combining them.

公开(公告)号：US20230090410A1

公开(公告)日：2023-03-23

申请号：US17819436

申请日：2022-08-12

Applicant: Meta Platforms Technologies, LLC

Inventor： Priyanka SHARMA ,  Camila Cortes DE ALMEIDA E DE VINCENZO ,  Norah Riley SMITH ,  Matthew Alan INSLEY

IPC: G06T19/00 ,  G06F3/01

Abstract: Aspects of the present technology can identify a current context of a device and select a background image for the device based on the context. Further aspects of the present technology can associate a user's command with an object in her environment. Yet further aspects of the present technology can map a user's range of wrist motion to coordinates of a selected region in an XR environment.