-
公开(公告)号:US11592908B2
公开(公告)日:2023-02-28
申请号:US17249966
申请日:2021-03-19
Applicant: GOOGLE LLC
Inventor: Dongeek Shin , Shahram Izadi , David Kim , Sofien Bouaziz , Steven Benjamin Goldberg , Ivan Poupyrev , Shwetak N. Patel
Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.
-
公开(公告)号:US20240045019A1
公开(公告)日:2024-02-08
申请号:US18254099
申请日:2021-02-02
Applicant: Google LLC
Inventor: Dongeek Shin , Steven Benjamin Goldberg , Richard Lee Marks
CPC classification number: G01S5/14 , G01S7/4021 , G01S5/04
Abstract: A method including retrieving a set of first ultra-wide band (UWB) data representing locations in a physical space and device locations in the physical space, the first UWB data representing the locations being tagged as associated with a device, generating a set of first coordinates based on the set of first UWB data, generating second UWB data representing a current location of the UWB tag device in the physical space, generating a second coordinate based on the second UWB data, generating a tiled set of coordinates by partitioning a plane associated with the physical space based on the set of first coordinates and the second coordinate, determining whether the UWB tag device is proximate to a tagged coordinate in the tiled set of coordinates, and in response to determining the UWB tag device is proximate to a tagged coordinate, initiating an action by the device associated with the tagged coordinate.
-
公开(公告)号:US20220373790A1
公开(公告)日:2022-11-24
申请号:US17303197
申请日:2021-05-24
Applicant: GOOGLE LLC
Inventor: Steven Benjamin Goldberg , Juston Payne , Michael Schoenberg
Abstract: Techniques of displaying content on a transparent display include detecting an individual present with respect to a world side, i.e., facing away from a user of a transparent display, opposite side of the transparent display as the user side. For example, circuitry connected to smartglasses detects the presence of an individual in the vicinity of the world side of a transparent display. In response, the circuitry causes an image of the individual to be generated and, based on the image, the circuitry classifies the individual as being in a state satisfying a set of criteria or not. In some implementations, the set of criteria include the individual being oriented in such a way as to be able to see the document. In response to the individual satisfying the criteria, the circuitry obscures the document from the view of the individual.
-
公开(公告)号:US12045933B2
公开(公告)日:2024-07-23
申请号:US17574881
申请日:2022-01-13
Applicant: GOOGLE LLC
Inventor: Dongeek Shin , Steven Benjamin Goldberg
CPC classification number: G06T15/506 , G06T3/02 , G06T7/50 , G06T7/70 , G06T11/00 , G06T2200/21 , G06T2207/10028
Abstract: Systems and methods related to simulated light-in-flight imaging are described. A computing device may execute a light-in-flight engine to process an optical image and a corresponding depth map to produce a light-in-flight image or video that simulates propagation of a wavefront across a scene. The light-in-flight engine may generate an optical simulation output by transforming a depth map to a three-dimensional lift domain to produce a three-dimensional data structure, then convolving the three-dimensional data structure with a convolutional operator, which may define a Gaussian sphere, to produce a filtered three-dimensional data structure. The light-in-flight engine then affine transforms the optical image with an identified slice of the filtered three-dimensional data structure to produce a light-in-flight image.
-
公开(公告)号:US11887513B2
公开(公告)日:2024-01-30
申请号:US18163067
申请日:2023-02-01
Applicant: GOOGLE LLC
Inventor: Clayton Woodward Bavor, Jr. , Steven Benjamin Goldberg , Zhiheng Jia
CPC classification number: G09G3/001 , G02B27/0172 , G06T3/60 , G02B2027/014 , G02B2027/0138 , G02B2027/0178 , G09G2320/0693 , G09G2340/0492
Abstract: Techniques include performing a display calibration while a smartglasses device is stored in a case that enables the smartglasses device to perform display calibrations. The case includes an optical device configured to form an image of a test pattern formed in a first display and a second display of the smartglasses device.
-
公开(公告)号:US20230418369A1
公开(公告)日:2023-12-28
申请号:US18035970
申请日:2020-12-30
Applicant: GOOGLE LLC
Inventor: Steven Benjamin Goldberg , Qiyue John Zhang , Dongeek Shin , Clayton Kimber
CPC classification number: G06F3/012 , G01S5/02585 , G01S5/0294 , G01S5/0278
Abstract: A wearable device, such as a head-wearable display (HWD), identifies a device pose based on a combination of angle-of-arrival (AOA) data generated by, for example, an ultra-wideband (UWB) positioning module, and inertial data generated by an inertial measurement unit (IMU). The HWD fuses the AOA data with the inertial data using data integration techniques such as one or more of stochastic estimation (e.g., a Kalman filter), a machine learning model, and the like, or any combination thereof. A computer device associated with the HWD can employ the fused data to identify a pose of the HWD (e.g., a six degree of freedom (6 DoF) pose) and can use the identified pose to modify virtual reality or augmented reality content implemented by the computer device, thereby providing an immersive and enjoyable experience for a user.
-
公开(公告)号:US20230393665A1
公开(公告)日:2023-12-07
申请号:US18174358
申请日:2023-02-24
Applicant: GOOGLE LLC
Inventor: Dongeek Shin , Shahram Izadi , David Kim , Sofien Bouaziz , Steven Benjamin Goldberg , Ivan Poupyrev , Shwetak N. Patel
Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.
-
公开(公告)号:US20240098409A1
公开(公告)日:2024-03-21
申请号:US18255231
申请日:2021-01-28
Applicant: GOOGLE LLC
Inventor: Steven Benjamin Goldberg
CPC classification number: H04R3/005 , H04R25/407 , H04R2430/20
Abstract: The disclosed devices and methods provide beamforming for a head-worn microphone array that can adapt to changes in the user's head position/orientation. The microphone array may be part of a head-worn computing device, which can be configured to automatically detect a direction for the beamforming based on computer-assisted recognition of a conversation with a participant. After the participant is identified, the beamforming can automatically steer the sensitivity of the microphone array towards the participant regardless of the position of the head user to improve a quality of the captured audio without constraining movement of a user. The improved audio may be used to aid in a user's hearing of the conversation, aid an augmented reality application corresponding to the conversation, and/or provide a degree of privacy by limiting sensitivity to participants in the conversation.
-
公开(公告)号:US20240064362A1
公开(公告)日:2024-02-22
申请号:US18260730
申请日:2021-02-01
Applicant: GOOGLE LLC
Inventor: Stuart James Myron Nicholson , Steven Benjamin Goldberg
IPC: H04N21/41 , H04N21/262 , H04N21/482
CPC classification number: H04N21/41265 , H04N21/26258 , H04N21/4825
Abstract: A non-transitory computer-readable storage medium can comprise instructions stored thereon. When executed by at least one processor, the instructions can be configured to cause a mobile computing device to receive, from a companion device, multiple files, each of the multiple files including at least media content, a trigger condition, and an action to be performed upon satisfaction of the trigger condition. The action included in at least one of the files can include playing media content from another one of the multiple files. The instructions can be further configured to cause the mobile computing device to play the media content included in at least one of the multiple files, receive at least one additional file from the companion device, erase at least one of the multiple files, and play media content included in the at least one additional file.
-
公开(公告)号:US20230245603A1
公开(公告)日:2023-08-03
申请号:US18163067
申请日:2023-02-01
Applicant: GOOGLE LLC
Inventor: Clayton Woodward Bavor, JR. , Steven Benjamin Goldberg , Zhiheng Jia
CPC classification number: G09G3/001 , G06T3/60 , G02B27/0172 , G09G2320/0693 , G09G2340/0492 , G02B2027/0178 , G02B2027/0138 , G02B2027/014
Abstract: Techniques include performing a display calibration while a smartglasses device is stored in a case that enables the smartglasses device to perform display calibrations. The case includes an optical device configured to form an image of a test pattern formed in a first display and a second display of the smartglasses device.
-
-
-
-
-
-
-
-
-