公开(公告)号：US20250068297A1

公开(公告)日：2025-02-27

申请号：US18454334

申请日：2023-08-23

Applicant: Meta Platforms Technologies, LLC

Inventor： Aaron SELIG ,  Katharine Ann NICHOLS ,  Ahad Habib BASRAVI ,  Nathaniel LANE ,  James Michael-K O'DONNELL ,  Jeremy EDELBLUT ,  Britt MIURA

IPC: G06F3/0482 ,  G06F3/01 ,  G06F3/04847 ,  G06F3/16

Abstract: Aspects of the present disclosure provide a quick actions menu in an artificial reality (XR) environment that can be accessed by performing a hand gesture detected by an XR device which, in some implementations, can be detected without the use of controllers. Once the menu is open, the user can move her hand while performing the gesture to highlight a particular quick action and can release the gesture on a highlighted action to select the action. In some implementations, the user can drill down into an action on the menu by highlighting the action, then dragging the gesture off of the action away from the menu. To close the quick actions menu, the user can either A) move the gesture off the menu and release the gesture, B) rotate the wrist, or C) explicitly dismiss the menu, such as by using a voice command detected by the XR device.

公开(公告)号：US20240281070A1

公开(公告)日：2024-08-22

申请号：US18310622

申请日：2023-05-02

Applicant: Meta Platforms Technologies, LLC

Inventor： Ali EMAMI ,  Aaron SELIG ,  Ahad Habib BASRAVI ,  James Michael-K O'DONNELL ,  Nathaniel LANE ,  Todd HARRIS

IPC: G06F3/01 ,  G06F3/0346 ,  G06V40/20

CPC classification number: G06F3/017 ,  G06F3/0346 ,  G06V40/28

Abstract: An artificial reality (XR) system includes XR controllers and hand gestures and corresponding representation of the hand gestures in XR space. Example implementations allow a user to use controllers for distance interaction and interactions that require controller buttons, but also recognize when the user extends her finger and wants to manually touch things-using touch in conjunction with controllers. Thus, if the user has a controller in her hand and wants to touch a UI element, she can also use her finger. In particular, the system identifies the finger is not touching the controller (e.g., via capacitance sensors) and that a hand pose is present (e.g., finger extended—from camera), thereby processing hand input from the finger without the user having to put down the controller.

公开(公告)号：US20240281071A1

公开(公告)日：2024-08-22

申请号：US18404111

申请日：2024-01-04

Applicant: Meta Platforms Technologies, LLC

Inventor： Ali EMAMI ,  Aaron SELIG ,  Ahad Habib BASRAVI ,  James Michael-K O'DONNELL ,  Nathaniel LANE ,  Todd HARRIS

IPC: G06F3/01 ,  G06F3/0346 ,  G06V40/20

CPC classification number: G06F3/017 ,  G06F3/0346 ,  G06V40/28

Abstract: Aspects of the present disclosure are directed to artificial reality (XR) controllers and hand gestures and corresponding representation of the hand gestures in XR space. Users can benefit from being able to use touch interactions while also holding the XR controller. Example implementations allow a user to use controllers for distance interaction and interactions that require controller buttons, but also recognize when the user extends her finger and wants to manually touch things-using touch in conjunction with controllers. Thus, if the user has a controller in her hand and want to touch a UI element, she can also use her finger, where the system identifies the finger not touching the controller (e.g., via capacitance sensors) and that a hand pose is present (e.g., finger extended—from camera) to allow that finger to provide hand input, without the user having to put down the controller.