-
公开(公告)号:US12248064B2
公开(公告)日:2025-03-11
申请号:US17651152
申请日:2022-02-15
Applicant: GOOGLE LLC
Inventor: Dongeek Shin , Adarsh Prakash Murthy Kowdle , Jingying Hu , Andrea Colaco
Abstract: Smart glasses including a first audio device, a second audio device, a frame including a first portion, a second portion, and a third portion, the second portion and the third portion are moveable in relation to the first portion, the second portion including the first audio device and the third portion including the second audio device, and a processor configured to cause the first audio device to generate a signal, receive the signal via the second audio device, estimate a distance based on the received signal, and determine a configuration of the frame.
-
2.
公开(公告)号:US20240004476A1
公开(公告)日:2024-01-04
申请号:US17809772
申请日:2022-06-29
Applicant: GOOGLE LLC
Inventor: Dongeek Shin , Andrea Colaco , Stiven Guillaume Francois Morvan , Adam James Banfield , Shahram Izadi
CPC classification number: G06F3/017 , G06V40/28 , G06V40/15 , G06V40/1318 , G06V20/20 , G06V10/82 , G06F1/163
Abstract: Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.
-
3.
公开(公告)号:US20240338084A1
公开(公告)日:2024-10-10
申请号:US18440605
申请日:2024-02-13
Applicant: GOOGLE LLC
Inventor: Dongeek Shin , Andrea Colaco , Stiven Guillaume Francois Morvan , Adam James Banfield , Shahram Izadi
CPC classification number: G06F3/017 , G06F1/163 , G06V10/82 , G06V20/20 , G06V40/1318 , G06V40/15 , G06V40/28
Abstract: Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.
-
公开(公告)号:US10380760B2
公开(公告)日:2019-08-13
申请号:US15476841
申请日:2017-03-31
Applicant: GOOGLE LLC
Inventor: Ghulam Ahmed Kirmani , Andrea Colaco
IPC: G06F3/01 , G06K9/00 , G06T7/73 , G06F3/042 , G08B13/184
Abstract: A process executes at an electronic system. The process identifies device characteristics of an imaging device that includes signal emitters and signal detectors. The process illuminates a field of view by signals from the signal emitters according to a modulation signal generated by the imaging device. At each of the signal detectors, the process obtains a response signal, and samples the response signals to form a response vector. The process obtains a lookup table corresponding to the modulation signal and the device characteristics. The field of view is partitioned into a 3-dimensional plurality of voxels, and the lookup table specifies, for each voxel, expected signals received by the signal detectors when the voxel is filled and the signal emitters illuminate the field of view according to the modulation signal. The process compares the response vector to the lookup table to determine which voxels are filled.
-
公开(公告)号:US20250045930A1
公开(公告)日:2025-02-06
申请号:US18792206
申请日:2024-08-01
Applicant: Google LLC
Inventor: Mar Gonzalez Franco , Junjiao Tian , Lavisha Aggarwal , Andrea Colaco
Abstract: Implementations relate to generation of segmentation masks for images in a zero-shot, unsupervised manner. Implementations also relate to generation of labels for the segmentation layers of the segmentation mask. Implementations use self-attention maps from a pass of the image through a generative image model to determine the segmentation mask and may use cross-attention maps generated when a prompt describing the image is provided with the image to the generative image model. Implementations aggregate maps from different resolutions to determine the mask and labels. The disclosed techniques enable accurate segmentation for any image without apriori training, facilitating applications in image processing, computer vision, extended reality applications, and robotics.
-
6.
公开(公告)号:US11934586B2
公开(公告)日:2024-03-19
申请号:US17809772
申请日:2022-06-29
Applicant: GOOGLE LLC
Inventor: Dongeek Shin , Andrea Colaco , Stiven Guillaume Francois Morvan , Adam James Banfield , Shahram Izadi
CPC classification number: G06F3/017 , G06F1/163 , G06V10/82 , G06V20/20 , G06V40/1318 , G06V40/15 , G06V40/28
Abstract: Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.
-
公开(公告)号:US10991123B2
公开(公告)日:2021-04-27
申请号:US16538647
申请日:2019-08-12
Applicant: GOOGLE LLC
Inventor: Ghulam Ahmed Kirmani , Andrea Colaco
Abstract: A process executes at an electronic system. The process identifies device characteristics of an imaging device that includes signal emitters and signal detectors. The process illuminates a field of view by signals from the signal emitters according to a modulation signal generated by the imaging device. At each of the signal detectors, the process obtains a response signal, and samples the response signals to form a response vector. The process obtains a lookup table corresponding to the modulation signal and the device characteristics. The field of view is partitioned into a 3-dimensional plurality of voxels, and the lookup table specifies, for each voxel, expected signals received by the signal detectors when the voxel is filled and the signal emitters illuminate the field of view according to the modulation signal. The process compares the response vector to the lookup table to determine which voxels are filled.
-
公开(公告)号:US10444865B2
公开(公告)日:2019-10-15
申请号:US15964499
申请日:2018-04-27
Applicant: GOOGLE LLC
Inventor: Ghulam Kirmani , Andrea Colaco , Luis Villaran , Chintan Trehan
IPC: G06F3/0346 , H03K19/177 , G02B27/01 , G06F3/01 , G06F3/03
Abstract: Techniques of tracking a hand controller in a VR system involves detecting, by photodiodes in the hand controller, patterns of diffuse radiation generated by diffuse LEDs in the HMD. Such techniques can also include comparing the detected patterns to those simulated offline previously and represented in a lookup table (LUT). By looking up the detected patterns in the LUT, the VR system may determine the position and/or orientation of the hand controller with sub-millimeter accuracy. Some advantages of the improved techniques can be in the simplicity and/or low cost of the components without sacrificing accuracy in deriving the position and orientation of the hand controller.
-
9.
公开(公告)号:US20180176514A1
公开(公告)日:2018-06-21
申请号:US15900766
申请日:2018-02-20
Applicant: Google LLC
Inventor: Ghulam Ahmed Kirmani , Andrea Colaco , Dongeek Shin
CPC classification number: H04N7/183 , G06K9/00201 , G06K9/00771 , G06K9/2018 , G06K9/2027 , G06K9/2036 , G06K9/4661 , G06K9/52 , G06T7/50 , G06T7/586 , G06T2207/10048 , G06T2207/10152 , G06T2207/30232 , H04N5/2226 , H04N5/2256 , H04N5/33 , H04N7/18 , H04N7/181
Abstract: A method generates depth maps at a camera having illuminators, a lens assembly, an image sensing element, a processor, and memory. The illuminators operate in a first mode to provide illumination, the lens assembly focuses incident light on the image sensing element, the memory stores image data from the image sensing element, and the processor executes programs to control operation of the camera. The method reconfigures the illuminators to operate in a second mode, where each of a plurality of subsets of the illuminators provides illumination of a scene separately. For each subset, the process activates the illuminators in the subset without activating illuminators not in the subset and receives reflected illumination from the scene incident on the lens assembly and focused onto the image sensing element. The measured light intensity of the received reflected illumination at the image sensing element is stored in association with activation of the subset.
-
公开(公告)号:US20250103197A1
公开(公告)日:2025-03-27
申请号:US18472071
申请日:2023-09-21
Applicant: GOOGLE LLC
Inventor: Nooshin Mojab , Dongeek Shin , Andrea Colaco
IPC: G06F3/04845 , G02B27/01 , G06F3/01 , G06F3/0482
Abstract: At least one sensor signal may be received from at least one motion sensor of a head-mounted device (HMD), the HMD being associated with a user interface (UI) displaying a UI selection element. A first value of the at least one sensor signal corresponding to a first position of the HMD and a second value of the at least one sensor signal corresponding to a second position of the HMD may be determined, and an initialization point within the UI may also be determined. Then, a relative displacement of the UI selection element may be determined, based on the initialization point, the first value, and the second value, and the UI selection element may be moved within the UI, based on the relative displacement.
-
-
-
-
-
-
-
-
-