公开(公告)号：US20180158348A1

公开(公告)日：2018-06-07

申请号：US15800006

申请日：2017-10-31

Applicant: Google LLC

Inventor： Vinay Venkataraman ,  Eric Aboussouan ,  David Frakes

IPC: G09B5/02 ,  B43K29/08 ,  B43K29/10 ,  B43K29/00

CPC classification number: G09B5/02 ,  B43K29/004 ,  B43K29/08 ,  B43K29/10 ,  G09B11/00

Abstract: Systems and methods for providing instructional guidance relating to an instructive writing instrument are provided. For instance, a first visual contextual signal instructing a user to actuate an instructive writing instrument in a first direction can be provided based at least in part on a model object. The model object can correspond to an object to be rendered on a writing surface by a user using the instructive writing instrument. A first image depicting the writing surface can be obtained. First position data associated with the instructive writing instrument can be determined based at least in part on the first image. A second visual contextual signal instructing the user to actuate the instructive writing instrument in a second direction can be provided based at least in part on the model object and the first position data associated with the instructive writing instrument.

公开(公告)号：US11868523B2

公开(公告)日：2024-01-09

申请号：US17305219

申请日：2021-07-01

Applicant: GOOGLE LLC

Inventor： Ivana Tosic Rodgers ,  Sean Ryan Francesco Fanello ,  Sofien Bouaziz ,  Rohit Kumar Pandey ,  Eric Aboussouan ,  Adarsh Prakash Murthy Kowdle

IPC: G06F3/01 ,  G02B27/00 ,  G02B27/01 ,  G06F18/23 ,  G06V20/20 ,  G06V40/18 ,  G06N3/08

CPC classification number: G06F3/013 ,  G02B27/0093 ,  G02B27/0101 ,  G02B27/0172 ,  G06F18/23 ,  G06N3/08 ,  G02B2027/0138 ,  G02B2027/0178

Abstract: Techniques of tracking a user's gaze includes identifying a region of a display at which a gaze of a user is directed, the region including a plurality of pixels. By determining a region rather than a point, when the regions correspond to elements of a user interface, the improved technique enables a system to activate the element to which a determined region is selected. In some implementations, the system makes the determination using a classification engine including a convolutional neural network; such an engine takes as input images of the user's eye and outputs a list of probabilities that the gaze is directed to each of the regions.

公开(公告)号：US20230004216A1

公开(公告)日：2023-01-05

申请号：US17305219

申请日：2021-07-01

Applicant: GOOGLE LLC

Inventor： Ivana Tosic Rodgers ,  Sean Ryan Francesco Fanello ,  Sofien Bouaziz ,  Rohit Kumar Pandey ,  Eric Aboussouan ,  Adarsh Prakash Murthy Kowdle

IPC: G06F3/01 ,  G06K9/62 ,  G02B27/00 ,  G02B27/01 ,  G06N3/08

Abstract: Techniques of tracking a user's gaze includes identifying a region of a display at which a gaze of a user is directed, the region including a plurality of pixels. By determining a region rather than a point, when the regions correspond to elements of a user interface, the improved technique enables a system to activate the element to which a determined region is selected. In some implementations, the system makes the determination using a classification engine including a convolutional neural network; such an engine takes as input images of the user's eye and outputs a list of probabilities that the gaze is directed to each of the regions.

公开(公告)号：US20220397958A1

公开(公告)日：2022-12-15

申请号：US17756441

申请日：2020-08-10

Applicant: Google LLC

Inventor： Eric Aboussouan

IPC: G06F3/01 ,  G06F3/0487

Abstract: A slippage resistant user interface (UI) may account for movement due to slippage, remounting and the like, of a head mounted display (HMD) device in processing user eye gaze in puts. The slippage resistant UI may include a number of UI elements. Each UI element may have a unique pattern of movement defining a display trajectory for that UI element, providing for differentiation amongst the UI elements. A user gaze trajectory may be matched with one of the display trajectories of the UI elements, and the corresponding UI element may be identified as the target UI element, intended for selection by the user. An eye to screen recalibration of the HMD may be accomplished using translational, scaling, and rotational offsets between the gaze trajectory and the display trajectory of the target UI element.

公开(公告)号：US20200027155A1

公开(公告)日：2020-01-23

申请号：US16487648

申请日：2018-03-27

Applicant: Google LLC

Inventor： David Frakes ,  David Lo ,  Eric Aboussouan ,  Mohamed Haitham Musa Babiker ,  Karl Patrick Lawrence ,  Roshanbir Bhatia ,  Mark Nelson

IPC: G06Q30/06 ,  G06N20/00 ,  G06T19/20 ,  G06T17/20

Abstract: Systems and methods for visualizing garment fit are provided. In one embodiment, the method can include obtaining garment data descriptive of a garment and body data descriptive of a body. The method can further include simulating a garment deformation of the garment due to contact from the body, and determining a simulating a body deformation of the body due to contact from the garment. The method can further include providing a visualization of the garment on the body for display to a user, the visualization visualizing the garment deformation and the body deformation.