公开(公告)号：US20250123679A1

公开(公告)日：2025-04-17

申请号：US18920449

申请日：2024-10-18

Applicant: Meta Platforms Technologies, LLC

Inventor： Tsz Ho Yu ,  Chengyuan Yan ,  Christian Forster

IPC: G06F3/01 ,  G06F18/25 ,  G06V20/10 ,  G06V40/20

Abstract: In one embodiment, a method includes capturing, using one or more cameras implemented in a wearable device worn by a user, a first image depicting at least a part of a hand of the user holding a controller in an environment, identifying one or more features from the first image to estimate a pose of the hand of the user, estimating a first pose of the controller based on the pose of the hand of the user and an estimated grip that defines a relative pose between the hand of the user and the controller, receiving IMU data of the controller, and estimating a second pose of the controller by updating the first pose of the controller using the IMU data of the controller. The method utilizes multiple data sources to track the controller under various conditions of the environment to provide an accurate controller tracking consistently.

公开(公告)号：US20250117091A1

公开(公告)日：2025-04-10

申请号：US18888018

申请日：2024-09-17

Applicant: Meta Platforms Technologies, LLC

Inventor： Chengyuan Yan ,  Yinglin Li ,  Qian Chen

IPC: G06F3/01 ,  A63F13/211 ,  A63F13/212 ,  A63F13/235 ,  G06F3/0346 ,  G06F3/038

Abstract: A method of interpreting a digit-to-digit gesture based on roll values for a wrist-wearable device is disclosed. The method includes, receiving an indication at a first point in time that a user donning the wrist-wearable device is providing a digit-to-digit gesture in which one of the user's digits touches another of the user's digits without contacting the display of the wearable device. The method further includes, in accordance with a determination that the digit-to-digit gesture is provided while data indicates that the wrist-wearable device has a first roll value, causing a target device in communication with the wearable device to perform a first input command and receiving another indication at a second point in time that is after the first point in time that the user is providing the digit-to-digit gesture again, causing the target device to perform a second input command that is distinct from the first input command.

公开(公告)号：US20240168567A1

公开(公告)日：2024-05-23

申请号：US18470306

申请日：2023-09-19

Applicant: Meta Platforms Technologies, LLC

Inventor： Alexandre Barachant ,  Bijan Treister ,  Shan Chu ,  Igor Gurovski ,  Chetan Parag Gupta ,  Tahir Turan Caliskan ,  Pascal Alexander Bentioulis ,  Viswanath Sivakumar ,  Zhong Zhang ,  Ramzi Elkhater ,  Maciej Lazarewicz ,  Per-Erik Bergstrom ,  Peter Andrew Matsimanis ,  Chengyuan Yan

IPC: G06F3/01 ,  G06F1/16 ,  G06F1/3231

CPC classification number: G06F3/017 ,  G06F1/163 ,  G06F1/3231 ,  G06F3/015

Abstract: The various implementations described herein include methods and systems for power-efficient processing of neuromuscular signals. In one aspect, a method includes: (i) obtaining a first set of neuromuscular signals; (ii) after determining, using a low-power detector, that the first set of neuromuscular signals require further processing to confirm that a predetermined in-air hand gesture has been performed: (a) processing the first set of neuromuscular signals using a high-power detector; and (b) in accordance with a determination that the processing indicates that the predetermined in-air hand gesture did occur, registering an occurrence of the predetermined in-air hand gesture; (iii) receiving a second set of neuromuscular signals; and (iv) after determining, using the low-power detector and not using the high-power detector, that a different predetermined in-air hand gesture was performed, performing an action in response to the different predetermined in-air hand gesture.

公开(公告)号：US11500413B2

公开(公告)日：2022-11-15

申请号：US17007401

申请日：2020-08-31

Applicant: Meta Platforms Technologies, LLC

Inventor： Boyang Zhang ,  Adrian Brian Ratter ,  Chengyuan Yan ,  Jack Hood Profit, Jr. ,  Paul Austin Buckley

IPC: G06F1/12 ,  H04W4/80 ,  G06T19/00 ,  H04L43/0829 ,  H04L67/131

Abstract: In one embodiment, a method includes receiving, from a controller, a data packet including (1) a plurality of samples each corresponding to measurements from a motion sensor and (2) a timestamp corresponding to a measurement time of one of the samples as measured by a clock of the controller; determining, based on the timestamp, an estimated measurement time relative to a local clock for each of the plurality of samples that is not associated with the timestamp; and converting each of the timestamp and the estimated measurement times to a corresponding synchronization time using a learned relationship relating the clock of the controller and the local clock. The learned relationship is iteratively learned based on previously received data packets from the controller. The synchronization time associated with each of the plurality of samples represents an estimated time, relative to the local clock, at which the sample was measured.

公开(公告)号：US12158992B1

公开(公告)日：2024-12-03

申请号：US18312571

申请日：2023-05-04

Applicant: Meta Platforms Technologies, LLC

Inventor： Chengyuan Yan ,  Willy Huang ,  Joseph Davis Greer ,  Sheng Shen ,  Szeyin Lee

IPC: G06F3/01 ,  G06V40/10

Abstract: Methods of interpreting in-air hand gestures based on orientations of a wrist-wearable device are provided. The method includes receiving, from sensors of a wrist-wearable device, data associated with performance of an in-air hand gesture during a first period of time. The method includes, when determining the data indicates that the wrist-wearable device had a first orientation when the in-air hand gesture was performed during the first period of time, causing performance of a first operation. The method includes receiving, from sensors of the wrist-wearable device, new data associated with performance of the in-air hand gesture during a second period of time, the second period of time being after the first period of time. The method includes, when determining that the new data indicates that the wrist-wearable device had a second orientation when the in-air hand gesture was performed during the second period of time, causing performance of a second operation.

公开(公告)号：US11670082B1

公开(公告)日：2023-06-06

申请号：US17543231

申请日：2021-12-06

Applicant: Meta Platforms Technologies, LLC

Inventor： Chengyuan Yan ,  Amrutha Hakkare Arunachala ,  Chengyuan Lin ,  Anush Mohan ,  Ke Huo

IPC: G06V20/20 ,  H04L67/131 ,  G06T15/20 ,  G06F3/01

CPC classification number: G06V20/20 ,  G06F3/012 ,  G06T15/205 ,  H04L67/131 ,  G06T2210/56 ,  G06T2210/61

Abstract: Systems and methods for providing a virtual space for multiple devices can include a first device having at least one sensor configured to acquire a spatial information of a physical space of the first device. The first device may include at least one processor configured to establish, according to the acquired spatial information, a virtual space corresponding to the physical space, that is accessible by a user of the first device via the first device. The at least one processor may further be configured to register a second device within the physical space, to allow a user of the second device to access the virtual space via the second device.

公开(公告)号：US12093464B2

公开(公告)日：2024-09-17

申请号：US17900809

申请日：2022-08-31

Applicant: Meta Platforms Technologies, LLC

Inventor： Yinglin Li ,  Qian Chen ,  Chengyuan Yan

IPC: G06F3/03 ,  A63F13/211 ,  A63F13/212 ,  A63F13/235 ,  G06F3/01 ,  G06F3/0346 ,  G06F3/038

CPC classification number: G06F3/017 ,  A63F13/211 ,  A63F13/212 ,  A63F13/235 ,  G06F3/015 ,  G06F3/0346 ,  G06F3/038 ,  A63F2300/1012 ,  A63F2300/1031 ,  A63F2300/105 ,  G06F2203/0384

Abstract: A method of interpreting a digit-to-digit gesture based on roll values for a wrist-wearable device is disclosed. The method includes, receiving an indication at a first point in time that a user donning the wrist-wearable device is providing a digit-to-digit gesture in which one of the user's digits touches another of the user's digits without contacting the display of the wearable device. The method further includes, in accordance with a determination that the digit-to-digit gesture is provided while data indicates that the wrist-wearable device has a first roll value, causing a target device in communication with the wearable device to perform a first input command and receiving another indication at a second point in time that is after the first point in time that the user is providing the digit-to-digit gesture again, causing the target device to perform a second input command that is distinct from the first input command.

公开(公告)号：US20240103626A1

公开(公告)日：2024-03-28

申请号：US18470825

申请日：2023-09-20

Applicant: Meta Platforms Technologies, LLC

Inventor： Dan Kun-yi Chen ,  Chengyuan Yan

IPC: G06F3/01 ,  G06F3/0354

CPC classification number: G06F3/016 ,  G06F3/03547 ,  G06F1/163

Abstract: The disclosed apparatus may include a wearable haptic ring that features input capabilities relative to a computing system. In various examples, the wearable haptic ring may be designed to curve around a human finger of a wearer with a touchpad that is seamlessly integrated with the ring. For example, the seamlessly integrated touchpad may be operable by another finger of the wearer. Moreover, the haptic ring may include a haptic feedback unit designed to provide haptic feedback in response to input from the wearer. As such, the haptic ring may enable a wide range of user inputs while appearing like a typical ring rather than a computer input/output device. Various other implementations are also disclosed.

公开(公告)号：US20230076068A1

公开(公告)日：2023-03-09

申请号：US17900809

申请日：2022-08-31

Applicant: Meta Platforms Technologies, LLC

Inventor： Yinglin Li ,  Qian Chen ,  Chengyuan Yan

IPC: G06F3/01 ,  G06F3/0346 ,  G06F3/038 ,  A63F13/235 ,  A63F13/212 ,  A63F13/211

Abstract: A method of interpreting a digit-to-digit gesture based on roll values for a wrist-wearable device is disclosed. The method includes, receiving an indication at a first point in time that a user donning the wrist-wearable device is providing a digit-to-digit gesture in which one of the user's digits touches another of the user's digits without contacting the display of the wearable device. The method further includes, in accordance with a determination that the digit-to-digit gesture is provided while data indicates that the wrist-wearable device has a first roll value, causing a target device in communication with the wearable device to perform a first input command and receiving another indication at a second point in time that is after the first point in time that the user is providing the digit-to-digit gesture again, causing the target device to perform a second input command that is distinct from the first input command.

公开(公告)号：US12153724B2

公开(公告)日：2024-11-26

申请号：US17719630

申请日：2022-04-13

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Tsz Ho Yu ,  Chengyuan Yan ,  Christian Forster

IPC: G06F3/01 ,  G06F18/25 ,  G06V20/10 ,  G06V40/20

Abstract: In one embodiment, a method includes capturing, using one or more cameras implemented in a wearable device worn by a user, a first image depicting at least a part of a hand of the user holding a controller in an environment, identifying one or more features from the first image to estimate a pose of the hand of the user, estimating a first pose of the controller based on the pose of the hand of the user and an estimated grip that defines a relative pose between the hand of the user and the controller, receiving IMU data of the controller, and estimating a second pose of the controller by updating the first pose of the controller using the IMU data of the controller. The method utilizes multiple data sources to track the controller under various conditions of the environment to provide an accurate controller tracking consistently.