Hand gesture recognition based on detected wrist muscular movements

    公开(公告)号:US11592908B2

    公开(公告)日:2023-02-28

    申请号:US17249966

    申请日:2021-03-19

    Applicant: GOOGLE LLC

    Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.

    SPATIALLY-AWARE CONTROLLER USING ULTRA-WIDEBAND TESSELLATION

    公开(公告)号:US20240045019A1

    公开(公告)日:2024-02-08

    申请号:US18254099

    申请日:2021-02-02

    Applicant: Google LLC

    CPC classification number: G01S5/14 G01S7/4021 G01S5/04

    Abstract: A method including retrieving a set of first ultra-wide band (UWB) data representing locations in a physical space and device locations in the physical space, the first UWB data representing the locations being tagged as associated with a device, generating a set of first coordinates based on the set of first UWB data, generating second UWB data representing a current location of the UWB tag device in the physical space, generating a second coordinate based on the second UWB data, generating a tiled set of coordinates by partitioning a plane associated with the physical space based on the set of first coordinates and the second coordinate, determining whether the UWB tag device is proximate to a tagged coordinate in the tiled set of coordinates, and in response to determining the UWB tag device is proximate to a tagged coordinate, initiating an action by the device associated with the tagged coordinate.

    REDUCING LIGHT LEAKAGE VIA EXTERNAL GAZE DETECTION

    公开(公告)号:US20220373790A1

    公开(公告)日:2022-11-24

    申请号:US17303197

    申请日:2021-05-24

    Applicant: GOOGLE LLC

    Abstract: Techniques of displaying content on a transparent display include detecting an individual present with respect to a world side, i.e., facing away from a user of a transparent display, opposite side of the transparent display as the user side. For example, circuitry connected to smartglasses detects the presence of an individual in the vicinity of the world side of a transparent display. In response, the circuitry causes an image of the individual to be generated and, based on the image, the circuitry classifies the individual as being in a state satisfying a set of criteria or not. In some implementations, the set of criteria include the individual being oriented in such a way as to be able to see the document. In response to the individual satisfying the criteria, the circuitry obscures the document from the view of the individual.

    System and method for simulating light-in-flight

    公开(公告)号:US12045933B2

    公开(公告)日:2024-07-23

    申请号:US17574881

    申请日:2022-01-13

    Applicant: GOOGLE LLC

    Abstract: Systems and methods related to simulated light-in-flight imaging are described. A computing device may execute a light-in-flight engine to process an optical image and a corresponding depth map to produce a light-in-flight image or video that simulates propagation of a wavefront across a scene. The light-in-flight engine may generate an optical simulation output by transforming a depth map to a three-dimensional lift domain to produce a three-dimensional data structure, then convolving the three-dimensional data structure with a convolutional operator, which may define a Gaussian sphere, to produce a filtered three-dimensional data structure. The light-in-flight engine then affine transforms the optical image with an identified slice of the filtered three-dimensional data structure to produce a light-in-flight image.

    DEVICE TRACKING WITH INTEGRATED ANGLE-OF-ARRIVAL DATA

    公开(公告)号:US20230418369A1

    公开(公告)日:2023-12-28

    申请号:US18035970

    申请日:2020-12-30

    Applicant: GOOGLE LLC

    CPC classification number: G06F3/012 G01S5/02585 G01S5/0294 G01S5/0278

    Abstract: A wearable device, such as a head-wearable display (HWD), identifies a device pose based on a combination of angle-of-arrival (AOA) data generated by, for example, an ultra-wideband (UWB) positioning module, and inertial data generated by an inertial measurement unit (IMU). The HWD fuses the AOA data with the inertial data using data integration techniques such as one or more of stochastic estimation (e.g., a Kalman filter), a machine learning model, and the like, or any combination thereof. A computer device associated with the HWD can employ the fused data to identify a pose of the HWD (e.g., a six degree of freedom (6 DoF) pose) and can use the identified pose to modify virtual reality or augmented reality content implemented by the computer device, thereby providing an immersive and enjoyable experience for a user.

    HAND GESTURE RECOGNITION BASED ON DETECTED WRIST MUSCULAR MOVEMENTS

    公开(公告)号:US20230393665A1

    公开(公告)日:2023-12-07

    申请号:US18174358

    申请日:2023-02-24

    Applicant: GOOGLE LLC

    CPC classification number: G06F3/017 G06F1/163 G06F3/014 G06V40/28

    Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.

    HEAD-WORN COMPUTING DEVICE WITH MICROPHONE BEAM STEERING

    公开(公告)号:US20240098409A1

    公开(公告)日:2024-03-21

    申请号:US18255231

    申请日:2021-01-28

    Applicant: GOOGLE LLC

    CPC classification number: H04R3/005 H04R25/407 H04R2430/20

    Abstract: The disclosed devices and methods provide beamforming for a head-worn microphone array that can adapt to changes in the user's head position/orientation. The microphone array may be part of a head-worn computing device, which can be configured to automatically detect a direction for the beamforming based on computer-assisted recognition of a conversation with a participant. After the participant is identified, the beamforming can automatically steer the sensitivity of the microphone array towards the participant regardless of the position of the head user to improve a quality of the captured audio without constraining movement of a user. The improved audio may be used to aid in a user's hearing of the conversation, aid an augmented reality application corresponding to the conversation, and/or provide a degree of privacy by limiting sensitivity to participants in the conversation.

    PLAYING MEDIA CONTENT IN RESPONSE TO TRIGGERS

    公开(公告)号:US20240064362A1

    公开(公告)日:2024-02-22

    申请号:US18260730

    申请日:2021-02-01

    Applicant: GOOGLE LLC

    CPC classification number: H04N21/41265 H04N21/26258 H04N21/4825

    Abstract: A non-transitory computer-readable storage medium can comprise instructions stored thereon. When executed by at least one processor, the instructions can be configured to cause a mobile computing device to receive, from a companion device, multiple files, each of the multiple files including at least media content, a trigger condition, and an action to be performed upon satisfaction of the trigger condition. The action included in at least one of the files can include playing media content from another one of the multiple files. The instructions can be further configured to cause the mobile computing device to play the media content included in at least one of the multiple files, receive at least one additional file from the companion device, erase at least one of the multiple files, and play media content included in the at least one additional file.

Patent Agency Ranking