-
公开(公告)号：US11468640B2
公开(公告)日：2022-10-11
申请号：US16530904
申请日：2019-08-02
申请人： Magic Leap, Inc.
发明人： Samuel A. Miller , Lomesh Agarwal , Lionel Ernest Edwin , Ivan Li Chuen Yeoh , Daniel Farmer , Sergey Fyodorovich Prokushkin , Yonatan Munk , Edwin Joseph Selker , Erik Fonseka , Paul M. Greco , Jeffrey Scott Sommers , Bradley Vincent Stuart , Shiuli Das , Suraj Manjunath Shanbhag
摘要： A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content has an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.
-
公开(公告)号：US20210409626A1
公开(公告)日：2021-12-30
申请号：US17293014
申请日：2019-10-30
申请人： Magic Leap, Inc.
摘要： An image sensor suitable for use in an augmented reality system to provide low latency image analysis with low power consumption. The augmented reality system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object and selectively output imaging information for that region. The region may be updated dynamically as the image sensor and/or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an augmented reality scene can be developed. The amount of data may be further reduced by configuring the image sensor to output indications of pixels for which the measured intensity of incident light changes.
-
公开(公告)号：US12008723B2
公开(公告)日：2024-06-11
申请号：US17962289
申请日：2022-10-07
申请人： Magic Leap, Inc.
发明人： Samuel A. Miller , Lomesh Agarwal , Lionel Ernest Edwin , Ivan Li Chuen Yeoh , Daniel Farmer , Sergey Fyodorovich Prokushkin , Yonatan Munk , Edwin Joseph Selker , Erik Fonseka , Paul M. Greco , Jeffrey Scott Sommers , Bradley Vincent Stuart , Shiuli Das , Suraj Manjunath Shanbhag
CPC分类号： G06T19/006 , G02B6/0076 , G02B27/0172 , G06F3/013 , G02B2027/014 , G06T2200/24
摘要： A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content has an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.
-
公开(公告)号：US11985440B2
公开(公告)日：2024-05-14
申请号：US17293029
申请日：2019-10-30
申请人： Magic Leap, Inc.
IPC分类号： H04N25/70 , G02B27/42 , H04N13/122 , H04N13/128 , H04N25/705 , H04N25/75
CPC分类号： H04N25/705 , G02B27/42 , H04N13/122 , H04N13/128 , H04N25/75
摘要： An image sensor suitable for use in an augmented reality system to provide low latency image analysis with low power consumption. The image sensor may have multiple pixel cells, each of the pixel cells comprising a photodetector to generate an electric signal based on an intensity of light incident upon the photodetector. The pixel cells may include multiple subsets of pixel cells, each subset of pixel cells including at least one angle-of-arrival to-intensity converter to modulate incident light reaching one or more of the pixel cells in the subset based on an angle of arrival of the incident light. Each pixel cell within the plurality of pixel cells may include differential readout circuitry configured to output a readout signal only when an amplitude of a current electric signal from the photodetector is different from an amplitude of a previous electric signal from the photodetector.
-
公开(公告)号：US11902677B2
公开(公告)日：2024-02-13
申请号：US17293014
申请日：2019-10-30
申请人： Magic Leap, Inc.
IPC分类号： H04N25/50 , G06T11/00 , H04N25/702
CPC分类号： H04N25/50 , G06T11/00 , H04N25/702
摘要： An image sensor suitable for use in an augmented reality system to provide low latency image analysis with low power consumption. The augmented reality system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object and selectively output imaging information for that region. The region may be updated dynamically as the image sensor and/or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an augmented reality scene can be developed. The amount of data may be further reduced by configuring the image sensor to output indications of pixels for which the measured intensity of incident light changes.
-
公开(公告)号：US20220301217A1
公开(公告)日：2022-09-22
申请号：US17597026
申请日：2020-07-01
申请人： Magic Leap, Inc.
发明人： Bradley Vincent Stuart , Daniel Farmer , Tiejian Zhang , Shiuli Das , Suraj Manjunath Shanbhag , Erik Fonseka
摘要： Systems and methods for eye tracking latency enhancements. An example head-mounted system obtains a first image of an eye of a user. The first image is provided as input to a machine learning model which has been trained to generate iris and pupil segmentation data given an image of an eye. A second image of the eye is obtained. A set of locations in the second image at which one or more glints are shown is detected based on iris segmentation data generated for the first image. A region of the second image at which the pupil of the eye of the user is shown is identified based on pupil segmentation data generated for the first image. A pose of the eye of the user is determined based on the detected set of glint locations in the second image and the identified region of the second image.
-
公开(公告)号：US20240333866A1
公开(公告)日：2024-10-03
申请号：US18735634
申请日：2024-06-06
申请人： Magic Leap, Inc.
摘要： A high-resolution image sensor suitable for use in an augmented reality (AR) system. The AR system may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may have pixels configured to output events indicating changes in sensed IR light. Those pixels may be sensitive to IR light of the same frequency source as an active IR light source, and may be part of an eye tracking camera, oriented toward a user's eye. Changes in IR light may be used to determine the location of the user's pupil, which may be used in rendering virtual objects. The events may be generated and processed at a high rate, enabling the system to render the virtual object based on the user's gaze so that the virtual object will appear more realistic to the user.
-
公开(公告)号：US20240137664A1
公开(公告)日：2024-04-25
申请号：US18403673
申请日：2024-01-03
申请人： Magic Leap, Inc.
IPC分类号： H04N25/50 , G06T11/00 , H04N25/702
CPC分类号： H04N25/50 , G06T11/00 , H04N25/702
摘要： An image sensor suitable for use in an augmented reality system to provide low latency image analysis with low power consumption. The augmented reality system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object and selectively output imaging information for that region. The region may be updated dynamically as the image sensor and/or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an augmented reality scene can be developed. The amount of data may be further reduced by configuring the image sensor to output indications of pixels for which the measured intensity of incident light changes.
-
公开(公告)号：US11631213B2
公开(公告)日：2023-04-18
申请号：US16067210
申请日：2016-12-30
申请人： Magic Leap, Inc.
发明人： Erik Fonseka , Alexander Ilic
摘要： Forming a 3D representation of an object using a portable electronic device with a camera. A sequence of image frames, captured with the camera may be processed to generate 3D information about the object. This 3D information may be used to present a visual representation of the object as real-time feedback to a user, indicating confidence of 3D information for regions of the object. Feedback may be a composite image based on surfaces in a 3D model derived from the 3D information given visual characteristics derived from the image frames. The 3D information may be used in a number of ways, including as an input to a 3D printer or an input, representing, in whole or in part, an avatar for a game or other purposes. To enable processing to be performed on a portable device, a portion of the image frames may be selected for processing with higher resolution.
-
公开(公告)号：US11563926B2
公开(公告)日：2023-01-24
申请号：US16950752
申请日：2020-11-17
申请人： Magic Leap, Inc.
发明人： Alexander Ilic , Peter Weigand , Erik Fonseka
IPC分类号： H04N9/74 , H04N9/73 , G06T3/40 , H04N5/232 , G06V10/40 , G06V30/142 , G06V30/224 , G06V10/10
摘要： A smartphone may be freely moved in three dimensions as it captures a stream of images of an object. Multiple image frames may be captured in different orientations and distances from the object and combined into a composite image representing an image of the object. The image frames may be formed into the composite image based on representing features of each image frame as a set of points in a three dimensional point cloud. Inconsistencies between the image frames may be adjusted when projecting respective points in the point cloud into the composite image. Quality of the image frames may be improved by processing the image frames to correct errors. Distracting features, such as the finger of a user holding the object being scanned, can be replaced with background content. As the scan progresses, a direction for capturing subsequent image frames is provided to a user as a real-time feedback.
-
-
-
-
-
-
-
-
-
搜索结果
16 条记录 (耗时 0.02 秒)
