公开(公告)号：US20230072423A1

公开(公告)日：2023-03-09

申请号：US17722128

申请日：2022-04-15

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Christopher Osborn ,  Adam Berenzweig ,  Mason Remaley ,  Lana Awad ,  Arielle Susu-Mago ,  Michael Astolfi ,  Daniel Wetmore

IPC: G06T19/00 ,  G16H80/00 ,  G16H20/30 ,  G06F3/01 ,  A61B5/22 ,  A61B5/00 ,  A61B5/11

Abstract: The disclosed system for interacting with objects in an extended reality (XR) environment generated by an XR system may include (1) neuromuscular sensors configured to sense neuromuscular signals from a wrist of a user and (2) at least one computer processor programmed to (a) determine, based at least in part on the sensed neuromuscular signals, information relating to an interaction of the user with an object in the XR environment and (b) instruct the XR system to, based on the determined information relating to the interaction of the user with the object, augment the interaction of the user with the object in the XR environment. Other embodiments of this aspect include corresponding apparatus, and computer programs recorded on one or more computer storage devices, each configured to perform the actions of the methods.

公开(公告)号：US11567573B2

公开(公告)日：2023-01-31

申请号：US16577352

申请日：2019-09-20

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Adam Berenzweig ,  Daniel Wetmore

IPC: G06F3/01 ,  G06T19/00 ,  G02B27/01 ,  G06F3/00

Abstract: Methods and systems for providing input to an augmented reality system or an extended reality system based, at least in part, on neuromuscular signals. The methods and systems comprise detecting, using one or more neuromuscular sensors arranged on one or more wearable devices, neuromuscular signals from a user; determining that a computerized system is in a mode configured to provide input including text to the augmented reality system; identifying based, at least in part, on the neuromuscular signals and/or information based on the neuromuscular signals, the input, wherein the input is further identified based, at least in part, on the mode; and providing the identified input to the augmented reality system.

公开(公告)号：US20240061513A1

公开(公告)日：2024-02-22

申请号：US18359855

申请日：2023-07-26

Applicant: Meta Platforms Technologies, LLC

Inventor： Jason Lowell Reisman ,  Austin Ha ,  Zaina Edelson ,  Adam Berenzweig ,  Christopher Anderson

IPC: G06F3/01 ,  G06F1/16 ,  G06F3/0346

CPC classification number: G06F3/017 ,  G06F1/163 ,  G06F3/015 ,  G06F3/0346

Abstract: The various implementations described herein include methods and systems for using a multi-stage in-air hand gesture to activate user-interface interactions in a way that ensures low-false positive rates. In one aspect, a method includes, while a gating gesture is maintained, receiving a first indication of performance of an adjustment gesture of a first magnitude directed to a user interface object associated with a plurality of values. The method further includes, in response to receiving the first indication, adjusting the user interface object to have a first state after moving through some of the plurality of values based on the first magnitude. The method also includes, after receiving an indication of a release of the gating gesture, in response to receiving a second indication of performance of the adjustment gesture, forgoing adjusting the user interface object such that the user interface object continues to have the first state.

公开(公告)号：US11493993B2

公开(公告)日：2022-11-08

申请号：US17010689

申请日：2020-09-02

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Ran Rubin ,  Jason Lowell Reisman ,  Robert Phillips Cochran ,  Naor Brown ,  Nitzan Bartov ,  Joshua Duyan ,  Daniel Wetmore ,  Alexandre Barachant ,  Adam Berenzweig ,  Jeffrey Scott Seely ,  Christopher Anderson

IPC: G06F3/0481 ,  G06F3/01 ,  G06F40/274

Abstract: The disclosed computer-implemented method may include presenting, via a user interface, a sensory cue, and receiving, from neuromuscular sensors of a wearable device, various neuromuscular signals generated by a user wearing the wearable device, where the user generates the neuromuscular signals in response to the sensory cue being presented to the user via the user interface. The method may also include interpreting the received neuromuscular signals as input commands with respect to the sensory cue provided by the user interface, such that the input commands initiate performance of specified tasks within the user interface. The method may also include performing the specified tasks within the user interface according to the interpreted input commands. Various other methods, systems, and computer-readable media are also disclosed.

公开(公告)号：US20250117131A1

公开(公告)日：2025-04-10

申请号：US18905099

申请日：2024-10-02

Applicant: Meta Platforms Technologies, LLC

Inventor： Evgeniy Gabrilovich ,  Patrick William John Kaifosh ,  Shagun Sodhani ,  Michael Mandel ,  Stephen McAnearney ,  Adam Calhoun ,  Adam Berenzweig ,  Laurentius Johannes Paulus van der Maaten ,  Salvatore Candido ,  Chia-Jung Chang ,  Siddharth Reddy ,  Thomas Robert Reardon

IPC: G06F3/04883 ,  G06F3/01 ,  G06T11/00

Abstract: A method of identifying devolved sequences of handwriting motions is described. The method includes obtaining, via sensors of a wearable device of a computing system, data corresponding to a user attempting to perform a sequence of handwriting motions associated with one or more target inputs while wearing the wearable device. The method includes identifying, based on at least (i) the data corresponding to the user attempting to perform the sequence of handwriting motion and (ii) the one or more target inputs associated with the sequence of handwriting motions, a devolved sequence of handwriting motions to suggest to the user for inputting a respective target input of the one or more target inputs. The devolved sequence of handwriting motions is a different sequence and includes fewer handwriting motions as compared to the sequence of handwriting motions. And the method includes presenting a representation of the devolved sequence of handwriting motions.

公开(公告)号：US20240061514A1

公开(公告)日：2024-02-22

申请号：US18364396

申请日：2023-08-02

Applicant: Meta Platforms Technologies, LLC

Inventor： Jason Lowell Reisman ,  Luke O'Connor ,  Christopher Anderson ,  Adam Berenzweig ,  Austin Ha ,  Zaina Edelson ,  Szeyin Lee ,  Paulo Jose Telo Coelho ,  Edith Comas ,  Shaker Islam

IPC: G06F3/01 ,  G06F3/0485 ,  G06F3/0482 ,  G06F3/0487

CPC classification number: G06F3/017 ,  G06F3/015 ,  G06F3/0485 ,  G06F3/0482 ,  G06F3/0487

Abstract: The various implementations described herein include methods and systems for using hand gestures detected at a wearable device to navigate a user interface. An example method includes receiving, via one or more neuromuscular-signal sensors of a wrist-wearable device worn by a user, data generated during performance of an in-air wrist movement by a wrist of the user. The method also includes moving a point of focus on the user interface in accordance with the in-air wrist movement; and receiving, via the one or more neuromuscular-signal sensors, additional data generated during performance of an in-air gesture by the user. The method further includes determining that the in-air gesture is an execution gesture; and executing a command corresponding to the execution gesture.

公开(公告)号：US20230325002A1

公开(公告)日：2023-10-12

申请号：US18167756

申请日：2023-02-10

Applicant: Meta Platforms Technologies, LLC

Inventor： Ian Sebastian Murphy Bicking ,  Austin Ha ,  Adam Berenzweig

IPC: G06F3/01 ,  G06F3/16

CPC classification number: G06F3/017 ,  G06F3/015 ,  G06F3/167 ,  G06F3/013

Abstract: The various implementations described herein include methods and systems for producing and modifying text using neuromuscular-signal-sensing devices. In one aspect, a method includes causing the display of a plurality of text terms input by a user. Using data from one or more neuromuscular-signal sensors in communication with the wearable device, an in-air hand gesture performed by the user is detected while the text terms are displayed. In response to the in-air hand gesture, a text-modification mode is enabled that allows for modifying the text terms input by the user. A target term is identified and, while the text-modification mode is enabled, data about a voice input provided by the user for modifying the target term is received. The method further includes causing a modification to the target term in accordance with the voice input from the user.

公开(公告)号：US11481031B1

公开(公告)日：2022-10-25

申请号：US17469537

申请日：2021-09-08

Applicant: Meta Platforms Technologies, LLC

Inventor： Christopher Anderson ,  Adam Berenzweig ,  Scott Draves ,  Daniel Wetmore

IPC: G06F3/041 ,  G06F3/01 ,  G06N5/04 ,  G02B27/01 ,  G06F1/16 ,  G06F3/0485

Abstract: The disclosed human computer interface (HCI) system may include (1) at least one processor, (2) a plurality of sensors that detect one or more neuromuscular signals from a forearm or wrist of a user, and (3) memory that stores (A) one or more trained inferential models that determine an amount of force associated with the one or more neuromuscular signals and (B) computer-executable instructions that, when executed by the at least one processor, cause the at least one processor to (I) identify the amount of force determined by the one or more trained inferential models, (II) determine that the amount of force satisfies a threshold force value, and in accordance with the determination that the amount of force satisfies the threshold force value, (III) generate a first input command for the HCI system. Various other devices, systems, and methods are also disclosed.