-
公开(公告)号:US11009715B2
公开(公告)日:2021-05-18
申请号:US16567204
申请日:2019-09-11
Applicant: Google LLC
Inventor: Samuel Jewell Lochner , Sui Tong Tang , Kevin R. Moule , Lukas Rezek , Ehsan Parvizi , Idris S. Aleem
Abstract: Systems and methods for fitting a wearable heads-up display (WHUD) to a subject are described. Imaging data representative of at least a portion of the subject's head with one or more gaze positions of the eyes is obtained from a plurality of cameras. One or more models representative of the subject's head are generated and a set of features is recognized in the one or more models. One or more models of the WHUD are also obtained based on WHUD data stored in memory. One or more simulations are performed positioning one or more WHUD models in proximity to at least one subject model based at least in part on the set of features recognized in the subject model. A fit of a WHUD to the subject is evaluated based at least in part on a determination regarding whether the simulation satisfies one or more of a set of criteria.
-
公开(公告)号:US11536970B1
公开(公告)日:2022-12-27
申请号:US17224690
申请日:2021-04-07
Applicant: GOOGLE LLC
Inventor: Sushant Kulkarni , Idris S. Aleem
Abstract: A wearable heads-up display (WHUD) obtains attribute data corresponding to an attribute of an item of interest and obtains environmental data of an environment surrounding the WHUD via one or more sensors of the WHUD. The WHUD compares the attribute data with the environmental data to detect the item of interest. In response to the detection, the WHUD obtains location data indicative of a location of the item of interest, stores the location data in association with a context of detection of the item of interest. In response to a trigger, such as a query by a user regarding the item of interest, the WHUD provides a location indication based on the location data, the location indication including, for example, a display of a description of the location of the item of interest, a display of the item of interest at the location, and the like.
-
3.
公开(公告)号:US10976814B2
公开(公告)日:2021-04-13
申请号:US16376319
申请日:2019-04-05
Applicant: GOOGLE LLC
Inventor: Idris S. Aleem , Andrew S. Logan , Mayank Bhargava
Abstract: A method of tracking an eye of a user includes generating an infrared light, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye over an eye tracking period. A plurality of glints is identified from the reflections of the infrared light detected. A glint center position of each glint in a glint space is determined and transformed to a gaze position in a display space. At least once during the eye tracking period, an image of the eye is reconstructed from a portion of the reflections of the infrared light detected. A pupil is detected from the image, and a pupil center position is determined. A glint-pupil vector is determined from the pupil center position and the glint center position of at least one glint corresponding in space to the pupil. The glint space is recalibrated based on the glint-pupil vector.
-
4.
公开(公告)号:US10936056B2
公开(公告)日:2021-03-02
申请号:US16376674
申请日:2019-04-05
Applicant: GOOGLE LLC
Inventor: Idris S. Aleem , Andrew S. Logan , Mayank Bhargava
IPC: G06F3/01 , H04N13/383 , G02B27/01
Abstract: A method of tracking an eye of a user includes generating infrared light over an eye tracking period, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye. Shifts in a position of a wearable heads-up display (WHUD) worn on the head of the user are detected during at least a portion of the eye tracking period. Glints are identified from the detected reflections of the infrared light. A drift in a glint center position of an identified glint relative to a glint space is determined based on a detected shift in position of the WHUD corresponding in space to the identified glint. The glint center position is adjusted to compensate for the drift. The adjusted glint center position is transformed from the glint space to a gaze position in a display space in a field of view of the eye.
-
公开(公告)号:US11157077B2
公开(公告)日:2021-10-26
申请号:US16376604
申请日:2019-04-05
Applicant: GOOGLE LLC
Inventor: Idris S. Aleem , Andrew S. Logan , Mayank Bhargava
Abstract: A method of tracking an eye of a user on a wearable heads-up display (WHUD) worn on the head of the user includes generating infrared light over an eye tracking period, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye. A motion parameter that is sensitive to motion of the WHUD is measured. Eye tracking is performed in a first mode that is based on glint for values of the motion parameter that fall within a first range of motion parameter values for which an error in measurement of glint position. Eye tracking is performed in a second mode that is based on glint-pupil vector for values of the motion parameter that fall within a second range of motion parameter values for which an error in measurement of glint position exceeds the error threshold. A head-mounted apparatus with eye tracking is disclosed.
-
6.
公开(公告)号:US11093034B2
公开(公告)日:2021-08-17
申请号:US16668677
申请日:2019-10-30
Applicant: GOOGLE LLC
Inventor: Idris S. Aleem , Mayank Bhargava , Andrew S. Logan
Abstract: A method of tracking a gaze position of an eye in a target space in a field of view of the eye over an eye tracking period includes performing a plurality of scans of the eye with infrared light within the eye tracking period. Each scan includes generating infrared light signals over a scan period and projecting the infrared light signals from a plurality of virtual light projectors to the eye to form a plurality of illumination areas on the eye. Reflections of the infrared light signals from the eye are detected for each scan. The gaze position of the eye in the target space is determined from the detected reflections of the infrared light signals for each scan.
-
公开(公告)号:US11238143B2
公开(公告)日:2022-02-01
申请号:US16412520
申请日:2019-05-15
Applicant: GOOGLE LLC
Inventor: Bergen Fletcher , Idris S. Aleem
Abstract: A method of operating a wearable heads-up display that in use is worn on a head of a user includes generating an infrared light, scanning the infrared light over an eye of the user, detecting reflections of infrared light from the eye of the user, and extracting test biometric identification data from at least a portion of the detected reflections and corresponding scan orientations. A similarity measure between the test biometric identification data and reference biometric identification data associated with the wearable heads-up display is determined. The user is authenticated based on the similarity measure.
-
公开(公告)号:US11042031B2
公开(公告)日:2021-06-22
申请号:US16269385
申请日:2019-02-06
Applicant: GOOGLE LLC
Inventor: Idris S. Aleem , Andrew S. Logan
Abstract: An eye tracking system for tracking an eye of a user includes at least one infrared laser diode to output an infrared light and an optical scanner positioned to receive the infrared light outputted by the at least one infrared laser diode and controllable to scan the infrared light over a target area. A holographic optical element is positioned at the target area to receive the infrared light from the optical scanner and redirect the infrared light to the eye of the user. An infrared detector is aligned to detect at least a portion of the infrared light returned from the eye of the user. An infrared filter is disposed in a position to selectively block transmission of infrared wavelengths through the holographic optical element from a side of the holographic optical element. An eyeglass lens, a wearable heads-up display, and a method of eye tracking are also described.
-
9.
公开(公告)号:US11619992B2
公开(公告)日:2023-04-04
申请号:US17224823
申请日:2021-04-07
Applicant: GOOGLE LLC
Inventor: Idris S. Aleem , Andrew S. Logan , Mayank Bhargava
Abstract: A method of tracking an eye of a user includes generating an infrared light, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye over an eye tracking period. A plurality of glints is identified from the reflections of the infrared light detected. A glint center position of each glint in a glint space is determined and transformed to a gaze position in a display space. At least once during the eye tracking period, an image of the eye is reconstructed from a portion of the reflections of the infrared light detected. A pupil is detected from the image, and a pupil center position is determined. A glint-pupil vector is determined from the pupil center position and the glint center position of at least one glint corresponding in space to the pupil. The glint space is recalibrated based on the glint-pupil vector.
-
10.
公开(公告)号:US20210223863A1
公开(公告)日:2021-07-22
申请号:US17224823
申请日:2021-04-07
Applicant: GOOGLE LLC
Inventor: Idris S. Aleem , Andrew S. Logan , Mayank Bhargava
Abstract: A method of tracking an eye of a user includes generating an infrared light, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye over an eye tracking period. A plurality of glints is identified from the reflections of the infrared light detected. A glint center position of each glint in a glint space is determined and transformed to a gaze position in a display space. At least once during the eye tracking period, an image of the eye is reconstructed from a portion of the reflections of the infrared light detected. A pupil is detected from the image, and a pupil center position is determined. A glint-pupil vector is determined from the pupil center position and the glint center position of at least one glint corresponding in space to the pupil. The glint space is recalibrated based on the glint-pupil vector.
-
-
-
-
-
-
-
-
-