公开(公告)号：US10989916B2

公开(公告)日：2021-04-27

申请号：US16545803

申请日：2019-08-20

Applicant: Google LLC

Inventor： Ivana Tosic Rodgers ,  David Chu ,  Mohammad Moharrami ,  Sebastian Sylvan

IPC: G02B27/00 ,  G02B27/01 ,  G06N3/04 ,  G06T19/00

Abstract: Systems, methods, and computer program products are described for receiving a request for a head pose prediction for an augmented reality experience, identifying at least one positional indicator and at least one rotational indicator associated with the augmented reality experience, and providing the at least one positional indicator and the at least one rotational indicator to a Recurrent Neural Network (RNN) comprising a plurality of cells. The RNN may include a plurality of recurrent steps that each include at least one of the plurality of cells and at least one fully connected (FC) layer. The RNN may be used to generate at least one pose prediction corresponding to head pose changes for the augmented reality experience for at least one upcoming time period, provide the at least one pose prediction and trigger display of augmented reality content based on the at least one pose prediction.

公开(公告)号：US11868523B2

公开(公告)日：2024-01-09

申请号：US17305219

申请日：2021-07-01

Applicant: GOOGLE LLC

Inventor： Ivana Tosic Rodgers ,  Sean Ryan Francesco Fanello ,  Sofien Bouaziz ,  Rohit Kumar Pandey ,  Eric Aboussouan ,  Adarsh Prakash Murthy Kowdle

IPC: G06F3/01 ,  G02B27/00 ,  G02B27/01 ,  G06F18/23 ,  G06V20/20 ,  G06V40/18 ,  G06N3/08

CPC classification number: G06F3/013 ,  G02B27/0093 ,  G02B27/0101 ,  G02B27/0172 ,  G06F18/23 ,  G06N3/08 ,  G02B2027/0138 ,  G02B2027/0178

Abstract: Techniques of tracking a user's gaze includes identifying a region of a display at which a gaze of a user is directed, the region including a plurality of pixels. By determining a region rather than a point, when the regions correspond to elements of a user interface, the improved technique enables a system to activate the element to which a determined region is selected. In some implementations, the system makes the determination using a classification engine including a convolutional neural network; such an engine takes as input images of the user's eye and outputs a list of probabilities that the gaze is directed to each of the regions.

公开(公告)号：US20230004216A1

公开(公告)日：2023-01-05

申请号：US17305219

申请日：2021-07-01

Applicant: GOOGLE LLC

Inventor： Ivana Tosic Rodgers ,  Sean Ryan Francesco Fanello ,  Sofien Bouaziz ,  Rohit Kumar Pandey ,  Eric Aboussouan ,  Adarsh Prakash Murthy Kowdle

IPC: G06F3/01 ,  G06K9/62 ,  G02B27/00 ,  G02B27/01 ,  G06N3/08

Abstract: Techniques of tracking a user's gaze includes identifying a region of a display at which a gaze of a user is directed, the region including a plurality of pixels. By determining a region rather than a point, when the regions correspond to elements of a user interface, the improved technique enables a system to activate the element to which a determined region is selected. In some implementations, the system makes the determination using a classification engine including a convolutional neural network; such an engine takes as input images of the user's eye and outputs a list of probabilities that the gaze is directed to each of the regions.

公开(公告)号：US20210055545A1

公开(公告)日：2021-02-25

申请号：US16545803

申请日：2019-08-20

Applicant: Google LLC

Inventor： Ivana Tosic Rodgers ,  David Chu ,  Mohammad Moharrami ,  Sebastian Sylvan

IPC: G02B27/00 ,  G06T19/00 ,  G06N3/04 ,  G02B27/01

Abstract: Systems, methods, and computer program products are described for receiving a request for a head pose prediction for an augmented reality experience, identifying at least one positional indicator and at least one rotational indicator associated with the augmented reality experience, and providing the at least one positional indicator and the at least one rotational indicator to a Recurrent Neural Network (RNN) comprising a plurality of cells. The RNN may include a plurality of recurrent steps that each include at least one of the plurality of cells and at least one fully connected (FC) layer. The RNN may be used to generate at least one pose prediction corresponding to head pose changes for the augmented reality experience for at least one upcoming time period, provide the at least one pose prediction and trigger display of augmented reality content based on the at least one pose prediction.