-
公开(公告)号:US20230110964A1
公开(公告)日:2023-04-13
申请号:US18065436
申请日:2022-12-13
Applicant: Google LLC
Inventor: Jason Todd Spencer , Seth Raphael , Sofien Bouaziz
Abstract: A wearable computing device includes a frame, a camera mounted on the frame so as to capture images of an environment outside of the wearable computing device, a display device mounted on the frame so as to display the images captured by the camera, and at least one eye gaze tracking device mounted on the frame so as to track a gaze directed at the images displayed by the display device. In response to the detection of a fixation of the gaze on the display of images, the system may identify a pixel area corresponding to a fixation point of the fixation gaze on the display of images. The system may identify an object in the ambient environment corresponding to the identified pixel area, and set the identified object as a selected object for user interaction.
-
公开(公告)号:US20220326766A1
公开(公告)日:2022-10-13
申请号:US17301588
申请日:2021-04-08
Applicant: Google LLC
Inventor: Jason Todd Spencer , Seth Raphael , Sofien Bouaziz
Abstract: A wearable computing device includes a frame, a camera mounted on the frame so as to capture images of an environment outside of the wearable computing device, a display device mounted on the frame so as to display the images captured by the camera, and at least one eye gaze tracking device mounted on the frame so as to track a gaze directed at the images displayed by the display device. In response to the detection of a fixation of the gaze on the display of images, the system may identify a pixel area corresponding to a fixation point of the fixation gaze on the display of images. The system may identify an object in the ambient environment corresponding to the identified pixel area, and set the identified object as a selected object for user interaction.
-
公开(公告)号:US11435857B1
公开(公告)日:2022-09-06
申请号:US17302283
申请日:2021-04-29
Applicant: GOOGLE LLC
Inventor: Qinge Wu , Seth Raphael , Alexander Gregory Chu , David Yu Chen , Mike Ma
IPC: G06F3/042 , G06F3/16 , G06F3/01 , G06F3/0487 , H04N5/232 , G06F3/0482
Abstract: In a general aspect, a head-mounted device (HMD) can be configured to receive a selection of a mode of operation of a content reader of the HMD from a plurality of modes of operation, and initiate, in response to the selection, a content capture process to capture content within a field of view (FOV) of a camera of the HMD. The HMD can be further configured to identify, in the captured content, a plurality of content items, receive a navigation command to select a content item from the plurality of content items, and provide, in response to the navigation command, readback of the selected content item.
-
公开(公告)号:US11055919B2
公开(公告)日:2021-07-06
申请号:US16395832
申请日:2019-04-26
Applicant: GOOGLE LLC
Inventor: Elena Nattinger , Austin McCasland , Seth Raphael
Abstract: According to an aspect, a method for managing augmented reality (AR) content in an AR environment includes obtaining image data associated with a scene of an AR environment, where the AR environment includes AR content positioned in a coordinate space of the AR environment. The method includes detecting a physical object from the image data, associating the physical object with the AR content, and storing coordinates of the AR content and information indicating that the physical object is associated with the AR content in an AR scene storage for future AR localization.
-
公开(公告)号:US10554953B2
公开(公告)日:2020-02-04
申请号:US15844599
申请日:2017-12-17
Applicant: GOOGLE LLC
Inventor: Seth Raphael
IPC: H04N7/173 , H04N13/261 , H04N13/194 , H04N13/161 , H04N21/234 , H04N21/472 , H04N21/6587 , H04N21/81
Abstract: A method includes receiving, from a device displaying a portion of a first frame of a streaming 360 degree video, an indication that a seek operation is triggered, the portion of the first frame being based on a view point of a user of the device, selecting a second frame of the streaming 360 degree video based on the seek operation, encoding a first portion of the second frame and a second portion of the second frame, the first portion of the second frame corresponding to the portion of the first frame, and communicating the encoded portion of the second frame to the device.
-
公开(公告)号:US11995899B2
公开(公告)日:2024-05-28
申请号:US17302291
申请日:2021-04-29
Applicant: Google LLC
Inventor: Qinge Wu , Grant Yoshida , Catherine Boulanger , Erik Hubert Dolly Goossens , Cem Keskin , Sofien Bouaziz , Jonathan James Taylor , Nidhi Rathi , Seth Raphael
CPC classification number: G06V20/63 , G02B27/0093 , G02B27/017 , G06V10/255 , G02B2027/0138 , G02B2027/014 , G06V30/10
Abstract: A head-mounted device (HMD) can be configured to determine a request for recognizing at least one content item included within content framed within a display of the HMD. The HMD can be configured to initiate a head-tracking process that maintains a coordinate system with respect to the content, and a pointer-tracking process that tracks a pointer that is visible together with the content within the display. The HMD can be configured to capture a first image of the content and a second image of the content, the second image including the pointer. The HMD can be configured to map a location of the pointer within the second image to a corresponding image location within the first image, using the coordinate system, and provide the at least one content item from the corresponding image location.
-
公开(公告)号:US11935286B2
公开(公告)日:2024-03-19
申请号:US17278935
申请日:2019-10-01
Applicant: GOOGLE LLC
Inventor: Luca Prasso , Seth Raphael
Abstract: A method of vertical planar surface detection includes identifying, at an electronic device, a plurality of feature points of an environment proximate the electronic device based on imagery captured at the electronic device and based on received non-visual pose information obtained from non-visual sensors. The electronic device queries the plurality of feature points to identify one or more planar surfaces in the imagery captured at the electronic device. Further, the electronic device computes a plurality of oriented point vectors associated with the one or more planar surfaces. A vertical planar surface is detected based at least in part on one or more of the plurality of oriented point vectors being aligned in a direction perpendicular to gravity within a predetermined threshold.
-
公开(公告)号:US20220350997A1
公开(公告)日:2022-11-03
申请号:US17302291
申请日:2021-04-29
Applicant: Google LLC
Inventor: Qinge Wu , Grant Yoshida , Catherine Boulanger , Erik Hubert Dolly Goossens , Cem Keskin , Sofien Bouaziz , Jonathan James Taylor , Nidhi Rathi , Seth Raphael
Abstract: A head-mounted device (HMD) can be configured to determine a request for recognizing at least one content item included within content framed within a display of the HMD. The HMD can be configured to initiate a head-tracking process that maintains a coordinate system with respect to the content, and a pointer-tracking process that tracks a pointer that is visible together with the content within the display. The HMD can be configured to capture a first image of the content and a second image of the content, the second image including the pointer. The HMD can be configured to map a location of the pointer within the second image to a corresponding image location within the first image, using the coordinate system, and provide the at least one content item from the corresponding image location.
-
公开(公告)号:US20200342669A1
公开(公告)日:2020-10-29
申请号:US16395832
申请日:2019-04-26
Applicant: GOOGLE LLC
Inventor: Elena Nattinger , Austin McCasland , Seth Raphael
Abstract: According to an aspect, a method for managing augmented reality (AR) content in an AR environment includes obtaining image data associated with a scene of an AR environment, where the AR environment includes AR content positioned in a coordinate space of the AR environment. The method includes detecting a physical object from the image data, associating the physical object with the AR content, and storing coordinates of the AR content and information indicating that the physical object is associated with the AR content in an AR scene storage for future AR localization.
-
公开(公告)号:US10222924B2
公开(公告)日:2019-03-05
申请号:US15914766
申请日:2018-03-07
Applicant: Google LLC
Inventor: Karissa A. Sawyer , Seungyon Lee , Seth Raphael , Thad Eugene Starner , Jonathan Moeller
Abstract: This document describes techniques and devices for an interactive cord with resistance touchpoints. An interactive cord includes an audio wire, and a fabric cover that covers the audio wire. The fabric cover includes at least one conductive thread integrated into the fabric cover to form at least one touchpoint at which the conductive thread makes contact with the audio wire when the touchpoint is pressed. The contact of the conductive thread with the audio wire creates a resistance value that is mapped to a control. The resistance value is based on a resistance of the conductive thread and a length of the conductive thread from a base of the interactive cord to the touchpoint. The resistance value is detectable by a controller implemented at a computing device that is coupled to the interactive cord. In response to detection of the resistance value, the controller triggers the control.
-
-
-
-
-
-
-
-
-