公开(公告)号：US11435857B1

公开(公告)日：2022-09-06

申请号：US17302283

申请日：2021-04-29

Applicant: GOOGLE LLC

Inventor： Qinge Wu ,  Seth Raphael ,  Alexander Gregory Chu ,  David Yu Chen ,  Mike Ma

IPC: G06F3/042 ,  G06F3/16 ,  G06F3/01 ,  G06F3/0487 ,  H04N5/232 ,  G06F3/0482

Abstract: In a general aspect, a head-mounted device (HMD) can be configured to receive a selection of a mode of operation of a content reader of the HMD from a plurality of modes of operation, and initiate, in response to the selection, a content capture process to capture content within a field of view (FOV) of a camera of the HMD. The HMD can be further configured to identify, in the captured content, a plurality of content items, receive a navigation command to select a content item from the plurality of content items, and provide, in response to the navigation command, readback of the selected content item.

公开(公告)号：US11995899B2

公开(公告)日：2024-05-28

申请号：US17302291

申请日：2021-04-29

Applicant: Google LLC

Inventor： Qinge Wu ,  Grant Yoshida ,  Catherine Boulanger ,  Erik Hubert Dolly Goossens ,  Cem Keskin ,  Sofien Bouaziz ,  Jonathan James Taylor ,  Nidhi Rathi ,  Seth Raphael

IPC: G06V20/62 ,  G02B27/00 ,  G02B27/01 ,  G06V10/20 ,  G06V30/10

CPC classification number: G06V20/63 ,  G02B27/0093 ,  G02B27/017 ,  G06V10/255 ,  G02B2027/0138 ,  G02B2027/014 ,  G06V30/10

Abstract: A head-mounted device (HMD) can be configured to determine a request for recognizing at least one content item included within content framed within a display of the HMD. The HMD can be configured to initiate a head-tracking process that maintains a coordinate system with respect to the content, and a pointer-tracking process that tracks a pointer that is visible together with the content within the display. The HMD can be configured to capture a first image of the content and a second image of the content, the second image including the pointer. The HMD can be configured to map a location of the pointer within the second image to a corresponding image location within the first image, using the coordinate system, and provide the at least one content item from the corresponding image location.

公开(公告)号：US20220350997A1

公开(公告)日：2022-11-03

申请号：US17302291

申请日：2021-04-29

Applicant: Google LLC

Inventor： Qinge Wu ,  Grant Yoshida ,  Catherine Boulanger ,  Erik Hubert Dolly Goossens ,  Cem Keskin ,  Sofien Bouaziz ,  Jonathan James Taylor ,  Nidhi Rathi ,  Seth Raphael

IPC: G06K9/32 ,  G02B27/01 ,  G02B27/00

Abstract: A head-mounted device (HMD) can be configured to determine a request for recognizing at least one content item included within content framed within a display of the HMD. The HMD can be configured to initiate a head-tracking process that maintains a coordinate system with respect to the content, and a pointer-tracking process that tracks a pointer that is visible together with the content within the display. The HMD can be configured to capture a first image of the content and a second image of the content, the second image including the pointer. The HMD can be configured to map a location of the pointer within the second image to a corresponding image location within the first image, using the coordinate system, and provide the at least one content item from the corresponding image location.