公开(公告)号：US20240281071A1

公开(公告)日：2024-08-22

申请号：US18404111

申请日：2024-01-04

Applicant: Meta Platforms Technologies, LLC

Inventor： Ali EMAMI ,  Aaron SELIG ,  Ahad Habib BASRAVI ,  James Michael-K O'DONNELL ,  Nathaniel LANE ,  Todd HARRIS

IPC: G06F3/01 ,  G06F3/0346 ,  G06V40/20

CPC classification number: G06F3/017 ,  G06F3/0346 ,  G06V40/28

Abstract: Aspects of the present disclosure are directed to artificial reality (XR) controllers and hand gestures and corresponding representation of the hand gestures in XR space. Users can benefit from being able to use touch interactions while also holding the XR controller. Example implementations allow a user to use controllers for distance interaction and interactions that require controller buttons, but also recognize when the user extends her finger and wants to manually touch things-using touch in conjunction with controllers. Thus, if the user has a controller in her hand and want to touch a UI element, she can also use her finger, where the system identifies the finger not touching the controller (e.g., via capacitance sensors) and that a hand pose is present (e.g., finger extended—from camera) to allow that finger to provide hand input, without the user having to put down the controller.

公开(公告)号：US20240281070A1

公开(公告)日：2024-08-22

申请号：US18310622

申请日：2023-05-02

Applicant: Meta Platforms Technologies, LLC

Inventor： Ali EMAMI ,  Aaron SELIG ,  Ahad Habib BASRAVI ,  James Michael-K O'DONNELL ,  Nathaniel LANE ,  Todd HARRIS

IPC: G06F3/01 ,  G06F3/0346 ,  G06V40/20

CPC classification number: G06F3/017 ,  G06F3/0346 ,  G06V40/28

Abstract: An artificial reality (XR) system includes XR controllers and hand gestures and corresponding representation of the hand gestures in XR space. Example implementations allow a user to use controllers for distance interaction and interactions that require controller buttons, but also recognize when the user extends her finger and wants to manually touch things-using touch in conjunction with controllers. Thus, if the user has a controller in her hand and wants to touch a UI element, she can also use her finger. In particular, the system identifies the finger is not touching the controller (e.g., via capacitance sensors) and that a hand pose is present (e.g., finger extended—from camera), thereby processing hand input from the finger without the user having to put down the controller.