公开(公告)号：US12097427B1

公开(公告)日：2024-09-24

申请号：US17822608

申请日：2022-08-26

Applicant: Meta Platforms Technologies, LLC

Inventor： Matthew Joel Schaefer ,  Evan Jones ,  Adria Navarro Lopez ,  Max Ma ,  Robert Berkebile ,  Alex Elsayad

IPC: A63F13/56 ,  A63F13/211 ,  A63F13/428

CPC classification number: A63F13/428 ,  A63F13/211 ,  A63F13/56

Abstract: Controlling an avatar in an XR environment can be based on input(s) from external, non-XR computing devices, such as mobile devices. An external device can capture sensor data, audio data, and/or image data, which are processed by an avatar control system to determine a gesture performed by the user, gauge the level of intensity or excitement of the user, and/or infer the user's sentiment or emotional state. The avatar control system can generate a motion plan based on these inferences drawn from the external device sensor data based on a baseline animation or motion template. The system can generate avatar animations that have exaggerated or understated expressions relative to the user's real-world gestures, possibly exceeding limitations of a kinematic model that otherwise constrain the avatar's animations. The technology can enable users to control an avatar in an XR environment without specialized XR equipment.

公开(公告)号：US12039141B2

公开(公告)日：2024-07-16

申请号：US17936490

申请日：2022-09-29

Applicant: Meta Platforms Technologies, LLC

Inventor： Alex Elsayad

IPC: G06F3/04815 ,  G06F3/0346 ,  G06F3/04842 ,  G06F3/04845 ,  G06F3/04886

CPC classification number: G06F3/04815 ,  G06F3/0346 ,  G06F3/04842 ,  G06F3/04845 ,  G06F3/04886

Abstract: Many users access artificial reality (XR) experiences through their mobile phones. However, it is difficult to translate XR experiences to a two-dimensional (2D) screen in a way that feels intuitive and natural. Thus, the technology can map an interaction plane in a three-dimensional (3D) scene to the 2D screen with as many affordances as possible, even if the plane is not parallel to the mobile phone. The plane can be a fixed surface or a dynamically changeable surface through which the user sends inputs through the 2D screen. The mapping of the plane to the 2D screen can control interaction with a virtual object on the interaction plane in the XR environment, enabling parity between the same experience on XR and non-XR interfaces.