-
公开(公告)号:US20220300082A1
公开(公告)日:2022-09-22
申请号:US17249966
申请日:2021-03-19
申请人: GOOGLE LLC
发明人: Dongeek Shin , Shahram Izadi , David Kim , Sofien Bouaziz , Steven Benjamin Goldberg , Ivan Poupyrev , Shwetak N. Patel
摘要: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.
-
公开(公告)号:US11868583B2
公开(公告)日:2024-01-09
申请号:US17656818
申请日:2022-03-28
申请人: Google LLC
发明人: Ruofei Du , Alex Olwal , Mathieu Simon Le Goc , David Kim , Danhang Tang
IPC分类号: G06F3/04815 , G02B27/01 , G10L15/22
CPC分类号: G06F3/04815 , G02B27/0172 , G02B27/0176 , G10L15/22 , G02B2027/0178 , G10L2015/223
摘要: Systems and methods are provided in which physical objects in the ambient environment can function as user interface implements in an augmented reality environment. A physical object detected within a field of view of a camera of a computing device may be designated as a user interface implement in response to a user command. User interfaces may be attached to the designated physical object, to provide a tangible user interface implement for user interaction with the augmented reality environment.
-
公开(公告)号:US20230393665A1
公开(公告)日:2023-12-07
申请号:US18174358
申请日:2023-02-24
申请人: GOOGLE LLC
发明人: Dongeek Shin , Shahram Izadi , David Kim , Sofien Bouaziz , Steven Benjamin Goldberg , Ivan Poupyrev , Shwetak N. Patel
摘要: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.
-
公开(公告)号:US20230206568A1
公开(公告)日:2023-06-29
申请号:US18000237
申请日:2020-06-22
申请人: GOOGLE LLC
CPC分类号: G06T19/006 , G06T7/50 , G06T15/506 , G06T7/90 , G06T7/70 , G06T19/20 , G06T2219/2012 , G06T2207/10028
摘要: A system and method for relighting of an augmented reality scene are provided. Image data and depth data corresponding to a physical environment may be captured by an image sensor of a computing device, for display in an AR scene generated by the computing device. The system may use the image data and depth data to generate a live depth map of the physical environment. A virtual light source may be placed in the AR scene of the physical environment in response to a user input. The system may relight the AR scene in response to the placement of the virtual light source based on the image data and the depth map.
-
公开(公告)号:US11030773B2
公开(公告)日:2021-06-08
申请号:US16798881
申请日:2020-02-24
申请人: Google LLC
发明人: Jonathan James Taylor , Vladimir Tankovich , Danhang Tang , Cem Keskin , Adarsh Prakash Murthy Kowdle , Philip L. Davidson , Shahram Izadi , David Kim
摘要: An electronic device estimates a pose of a hand by volumetrically deforming a signed distance field using a skinned tetrahedral mesh to locate a local minimum of an energy function, wherein the local minimum corresponds to the hand pose. The electronic device identifies a pose of the hand by fitting an implicit surface model of a hand to the pixels of a depth image that correspond to the hand. The electronic device uses a skinned tetrahedral mesh to warp space from a base pose to a deformed pose to define an articulated signed distance field from which the hand tracking module derives candidate poses of the hand. The electronic device then minimizes an energy function based on the distance of each corresponding pixel to identify the candidate pose that most closely approximates the pose of the hand.
-
公开(公告)号:US12079903B1
公开(公告)日:2024-09-03
申请号:US18341461
申请日:2023-06-26
申请人: Google LLC
CPC分类号: G06T11/00 , G06F3/011 , G06F3/017 , G06T7/70 , G06V20/20 , G06V20/41 , G06K7/1417 , G06T2207/10016 , G06T2207/30196 , H04L67/131
摘要: Methods and systems for displaying screens in extended reality are disclosed herein. The method can include receiving video data of a real-world environment of a user of an extended reality device and identifying a screen of a separate computing device in the video data. The method can also include pairing the extended reality device and the separate computing device, generating a graphical outline around the screen of the separate computing device, and displaying, by the processor, the screen of the separate computing device and the graphical outline around the screen of the separate computing device on a display of the extended reality device. The method can further include detecting a user interaction with the graphical outline around the screen of the separate computing device based on the received video data and in response to detecting the user interaction, performing an action associated with the user interaction.
-
公开(公告)号:US11347320B1
公开(公告)日:2022-05-31
申请号:US17304986
申请日:2021-06-29
申请人: Google LLC
发明人: Dongeek Shin , David Kim , Sofien Bouaziz
摘要: A computing device, such as a wearable device, may include a gesture sensor that generates a gesture signal in response to a gesture of a user performed while the computing device is being worn or held by the user. A calibration sensor may generate a calibration signal characterizing a degree of tightness with which the computing device is being worn or held by the user. The gesture signal may be calibrated using the calibration signal, to obtain a calibrated gesture signal that is calibrated with respect to the degree of tightness. At least one function of the at least one computing device may be implemented, based on the calibrated gesture signal.
-
公开(公告)号:US12073028B2
公开(公告)日:2024-08-27
申请号:US18174358
申请日:2023-02-24
申请人: GOOGLE LLC
发明人: Dongeek Shin , Shahram Izadi , David Kim , Sofien Bouaziz , Steven Benjamin Goldberg , Ivan Poupyrev , Shwetak N. Patel
摘要: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.
-
公开(公告)号:US20240144523A1
公开(公告)日:2024-05-02
申请号:US18495483
申请日:2023-10-26
申请人: GOOGLE LLC
CPC分类号: G06T7/73 , G06T7/80 , G06T2207/10012 , G06T2207/10048 , G06T2207/20084 , G06T2207/30204
摘要: According to an aspect, a method may include receiving two-dimensional (2D) positions of at least one of a first reflective marker or a second reflective marker of a physical component, estimating a three-dimensional (3D) position of the first reflective marker and a 3D position of the second reflective marker based on the 2D positions, and computing an orientation of the physical component in 3D space based on the 3D position of the first reflective marker, the 3D position of the second reflective marker, and positioning information of the first and second reflective markers in the physical component.
-
公开(公告)号:US20230305672A1
公开(公告)日:2023-09-28
申请号:US17656818
申请日:2022-03-28
申请人: Google LLC
发明人: Ruofei Du , Alex Olwal , Mathieu Simon Le Goc , David Kim , Danhang Tang
IPC分类号: G06F3/04815 , G10L15/22 , G02B27/01
CPC分类号: G06F3/04815 , G10L15/22 , G02B27/0172 , G02B27/0176 , G02B2027/0178 , G10L2015/223
摘要: Systems and methods are provided in which physical objects in the ambient environment can function as user interface implements in an augmented reality environment. A physical object detected within a field of view of a camera of a computing device may be designated as a user interface implement in response to a user command. User interfaces may be attached to the designated physical object, to provide a tangible user interface implement for user interaction with the augmented reality environment.
-
-
-
-
-
-
-
-
-