-
公开(公告)号:US20240077943A1
公开(公告)日:2024-03-07
申请号:US18387745
申请日:2023-11-07
Applicant: Magic Leap, Inc.
Inventor: David Cohen , Elad Joseph , Ron Nisim Ferens , Eyal Preter , Eitan Shmuel Bar-On , Giora Yahav
CPC classification number: G06F3/013 , G02B27/0093 , G02B27/0172 , G06T7/246 , G06T7/292 , G06T7/73 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G06T2207/30201
Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system possibly comprising a plurality of cameras that image the user's eye and glints for thereon and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye using cornea data derived from the glint images. The display system may render virtual image content with a render camera positioned at the determined position of the center of rotation of said eye.
-
公开(公告)号:US11675432B2
公开(公告)日:2023-06-13
申请号:US17659145
申请日:2022-04-13
Applicant: Magic Leap, Inc.
Inventor: Daniel Farmer , David Cohen , Bradley Vincent Stuart
CPC classification number: G06F3/013 , G06T7/77 , G06T2207/10152 , G06T2207/30201
Abstract: An eye tracking system can include an eye-tracking camera configured to obtain images of the eye at different exposure times or different frame rates. For example, longer exposure images of the eye taken at a longer exposure time can show iris or pupil features, and shorter exposure, glint images can show peaks of glints reflected from the cornea. The shorter exposure glint images may be taken at a higher frame rate (than the longer exposure images) for accurate gaze prediction. The shorter exposure glint images can be analyzed to provide glint locations to subpixel accuracy. The longer exposure images can be analyzed for pupil center or center of rotation. The eye tracking system can predict future gaze direction, which can be used for foveated rendering by a wearable display system. In some instances, the eye-tracking system may estimate the location of a partially or totally occluded glint.
-
公开(公告)号:US20220269344A1
公开(公告)日:2022-08-25
申请号:US17744506
申请日:2022-05-13
Applicant: Magic Leap, Inc.
Inventor: David Cohen
Abstract: An eye tracking system can include an eye-tracking camera configured to obtain images of the eye at different exposure times or different frame rates. For example, longer exposure images of the eye taken at a longer exposure time can show iris or pupil features, and shorter exposure, glint images can show peaks of glints reflected from the cornea. The shorter exposure glint images may be taken at a higher frame rate (than the longer exposure images) for accurate gaze prediction. The shorter exposure glint images can be analyzed to provide glint locations to subpixel accuracy. The longer exposure images can be analyzed for pupil center or center of rotation. The eye tracking system can predict future gaze direction, which can be used for foveated rendering by a wearable display system.
-
公开(公告)号:US10923515B2
公开(公告)日:2021-02-16
申请号:US16219829
申请日:2018-12-13
Applicant: Magic Leap, Inc.
Inventor: Erez Tadmor , David Cohen , Giora Yahav
IPC: H04N5/235 , H01L27/146 , H04N5/3745 , H04N5/232 , G01S11/00 , H04N5/341
Abstract: An image sensor device includes a plurality of pixel cells arranged in a pixel array, a control circuit for controlling an exposure phase and a sampling phase of the image sensor device. Each of the plurality of pixel cells includes a photodiode, a storage diode, and a floating diffusion region. The control circuit is configured to activate the photodiode in a plurality of time windows to sense light reflected from a target as a result of a corresponding plurality of emitted light pulses, with a pre-determined delay time between each time window and a corresponding emitted light pulse. The photodiode can be activated using a plurality of bias voltage pulses or a plurality of global shutter signal pulses.
-
公开(公告)号:US20210004975A1
公开(公告)日:2021-01-07
申请号:US16936345
申请日:2020-07-22
Applicant: Magic Leap, Inc.
Inventor: David Cohen , Asaf Pellman , Shai Mazor , Erez Tadmor , Giora Yahav
Abstract: A method for determining a distance to a target object includes transmitting light pulses to illuminate the target object and sensing, in a first region of a light-sensitive pixel array, light provided from an optical feedback device that receives a portion of the transmitted light pulses. The feedback optical device includes a preset reference depth. The method includes calibrating time-of-flight (TOF) depth measurement reference information based on the sensed light in the first region of the pixel array. The method further includes sensing, in a second region of the light-sensitive pixel array, light reflected from the target object from the transmitted light pulses. The distance of the target object is determined based on the sensed reflected light and the calibrated TOF measurement reference information.
-
公开(公告)号:US20200372678A1
公开(公告)日:2020-11-26
申请号:US16878366
申请日:2020-05-19
Applicant: Magic Leap, Inc.
Inventor: Daniel Farmer , David Cohen , Bradley Vincent Stuart
Abstract: An eye tracking system can include an eye-tracking camera configured to obtain images of the eye at different exposure times or different frame rates. For example, longer exposure images of the eye taken at a longer exposure time can show iris or pupil features, and shorter exposure, glint images can show peaks of glints reflected from the cornea. The shorter exposure glint images may be taken at a higher frame rate (than the longer exposure images) for accurate gaze prediction. The shorter exposure glint images can be analyzed to provide glint locations to subpixel accuracy. The longer exposure images can be analyzed for pupil center or center of rotation. The eye tracking system can predict future gaze direction, which can be used for foveated rendering by a wearable display system. In some instances, the eye-tracking system may estimate the location of a partially or totally occluded glint.
-
公开(公告)号:US20180095165A1
公开(公告)日:2018-04-05
申请号:US15721232
申请日:2017-09-29
Applicant: Magic Leap, Inc.
Inventor: David Cohen , Assaf Pellman , Robert D. TeKolste , Shlomo Felzenshtein , Giora Yahav
Abstract: A time of flight based depth detection system is disclosed that includes a projector configured to sequentially emit multiple complementary illumination patterns. A sensor of the depth detection system is configured to capture the light from the illumination patterns reflecting off objects within the sensor's field of view. The data captured by the sensor can be used to filter out erroneous readings caused by light reflecting off multiple surfaces prior to returning to the sensor.
-
公开(公告)号:US20230040144A1
公开(公告)日:2023-02-09
申请号:US17865107
申请日:2022-07-14
Applicant: Magic Leap, Inc.
Inventor: Erez Tadmor , David Cohen , Giora Yahav
IPC: H01L27/146 , G01S11/00 , G01S17/894 , H04N5/235 , H04N5/341 , H04N5/3745 , H04N5/232
Abstract: An imaging system includes an illumination unit and a sensor unit disposed on a printed circuit board. The illumination unit includes a diode laser source inside an illumination housing. The sensor unit includes an image sensor having a pixel array and a lens barrel mounted on the image sensor with an adhesive, and an optical fiber coupled between the illumination housing and image sensor. The optical fiber is configured to collect a portion of light from the interior of the illumination housing that is emitted by the diode laser source and direct the portion of light to a corner of the pixel array of the image sensor that is located outside the lens barrel.
-
公开(公告)号:US20250076978A1
公开(公告)日:2025-03-06
申请号:US18948073
申请日:2024-11-14
Applicant: Magic Leap, Inc.
Inventor: David Cohen , Elad Joseph , Ron Nisim Ferens , Eyal Preter , Eitan Shmuel Bar-On , Giora Yahav
Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system possibly comprising a plurality of cameras that image the user's eye and glints for thereon and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of rotation of the user's eye using cornea data derived from the glint images. The display system may render virtual image content with a render camera positioned at the determined position of the center of rotation of said eye.
-
公开(公告)号:US12066545B2
公开(公告)日:2024-08-20
申请号:US17210152
申请日:2021-03-23
Applicant: Magic Leap, Inc.
Inventor: David Cohen , Elad Joseph , Eyal Preter , Paul Lacey , Koon Keong Shee , Evyatar Bluzer
IPC: G01S17/894 , G06F3/01 , G06F3/03
CPC classification number: G01S17/894 , G06F3/017 , G06F3/0325
Abstract: Techniques are disclosed for operating a time-of-flight (TOF) sensor. The TOF may be operated in a low power mode by repeatedly performing a low power mode sequence, which may include performing a depth frame by emitting light pulses, detecting reflected light pulses, and computing a depth map based on the detected reflected light pulses. Performing the low power mode sequence may also include performing an amplitude frame at least one time by emitting a light pulse, detecting a reflected light pulse, and computing an amplitude map based on the detected reflected light pulse. In response to determining that an activation condition is satisfied, the TOF may be switched to operate in a high accuracy mode by repeatedly performing a high accuracy mode sequence, which may include performing the depth frame multiple times.
-
-
-
-
-
-
-
-
-