-
公开(公告)号:US20240223906A1
公开(公告)日:2024-07-04
申请号:US18601406
申请日:2024-03-11
Applicant: Magic Leap, Inc.
Inventor: Brian Keith Smith , Ilya Tsunaev
IPC: H04N23/72 , H04N5/222 , H04N5/265 , H04N23/63 , H04N23/71 , H04N23/73 , H04N23/741 , H04N23/743 , H04N23/76
CPC classification number: H04N23/72 , H04N5/2226 , H04N5/265 , H04N23/71 , H04N23/73 , H04N23/741 , H04N23/743 , H04N23/76 , H04N23/63
Abstract: A method includes receiving a first image captured by a content capture device included in a mixed reality or augmented reality device, identifying a location corresponding to a pixel group of a plurality of pixel groups in the first image, and determining, for each location, one or more updates for one or more settings of the content capture device. The method also includes iteratively: updating the content capture device using an update of the one or more updates, capturing an image of a predetermined number of images using the content capture device and the update of the one or more updates, and repeating updating the content capture device and capturing the image the predetermined number of times. The method also includes stitching the predetermined number of images together to form a composite image.
-
公开(公告)号:US20220201210A1
公开(公告)日:2022-06-23
申请号:US17690956
申请日:2022-03-09
Applicant: Magic Leap, Inc.
Inventor: Brian Keith Smith , Koon Keong Shee , Gregory Michael Link
IPC: H04N5/232 , H04N13/139 , H04N13/296 , G06F3/00 , G01S17/894
Abstract: A system and method for operating a depth sensor. A configuration operation can be performed by storing a first sequence of operation steps which define a first depth sensing mode of operation, and a second sequence of operation steps which define a second depth sensing mode of operation, in the memory. In response to a first request for depth measurements according to the first depth sensing mode of operation, the depth sensor can be operated in the first mode of operation by causing it to execute the first sequence of operation steps. In response to a second request for depth measurements according to the second depth sensing mode of operation, and without performing an additional configuration operation, the depth sensor can be operated in the second mode of operation by causing it to execute the second sequence of operation steps.
-
公开(公告)号:US20210195092A1
公开(公告)日:2021-06-24
申请号:US17127415
申请日:2020-12-18
Applicant: Magic Leap, Inc.
Inventor: Sheh-Che Huang , Christian Ivan Robert Moore , Brian Keith Smith
Abstract: A method includes capturing an image using a content capture device with an initial image setting. The image includes a plurality of pixel groups, and a pixel group can have one or more pixels. A plurality of edge pixel groups is identified and then classified into two subsets. A first subset of saturated edge pixel groups includes edge pixel groups that have at least one neighboring pixel group with an image intensity exceeding a saturated intensity value. A second subset of non-saturated edge pixel groups includes edge pixel groups that have no neighboring pixel groups with an image intensity exceeding a saturated intensity value. An adjustment value to the image setting is determined based on a total number of saturated edge pixel groups and a total number of non-saturated edge pixel groups. An updated image is captured with an updated image setting based on the adjustment value.
-
公开(公告)号:US10701276B2
公开(公告)日:2020-06-30
申请号:US15841043
申请日:2017-12-13
Applicant: Magic Leap, Inc.
Inventor: Brian Keith Smith , Ilya Tsunaev
Abstract: Provided are methods, systems, and computer-program products for determining one or more settings of a content capture device. In some examples, to determine the one or more settings, luma values of pixels of an image from the content capture device may be identified. Objects in the image and information associated with the objects may also be identified. The information associated with the objects may be divided into categories of the information. And using the objects and the information, a separate weight array for each category of the information may be computed. The separate weight arrays may be combined to create a total weight array to augment the luma values. The augmented luma values may be aggregated to compute a weighted luma average for the image. Based upon a difference of the weighted luma average and a target, the one or more settings may be adjusted.
-
公开(公告)号:US11968456B2
公开(公告)日:2024-04-23
申请号:US17688330
申请日:2022-03-07
Applicant: Magic Leap, Inc.
Inventor: Brian Keith Smith , Ilya Tsunaev
IPC: H04N23/72 , H04N5/222 , H04N5/265 , H04N23/63 , H04N23/71 , H04N23/73 , H04N23/741 , H04N23/743 , H04N23/76
CPC classification number: H04N23/72 , H04N5/2226 , H04N5/265 , H04N23/71 , H04N23/73 , H04N23/741 , H04N23/743 , H04N23/76 , H04N23/63
Abstract: A method for computing a total weight array includes receiving an image frame captured by a content capture device and identifying a plurality of objects in the image frame. Each object of the plurality of objects corresponds to one of a plurality of pixel groups. The method also includes providing a plurality of neural networks and calculating, for each object of the plurality of objects, an object weight using a corresponding neural network of the plurality of neural networks. The method further includes computing the total weight array by summing the object weight for each of the plurality of objects.
-
公开(公告)号:US11778318B2
公开(公告)日:2023-10-03
申请号:US17690956
申请日:2022-03-09
Applicant: Magic Leap, Inc.
Inventor: Brian Keith Smith , Koon Keong Shee , Gregory Michael Link
IPC: H04N13/139 , H04N23/667 , H04N13/296 , G06F3/00 , G01S17/894 , H04N23/959
CPC classification number: H04N23/667 , G01S17/894 , G06F3/00 , H04N13/139 , H04N13/296 , H04N23/959
Abstract: A system and method for operating a depth sensor. A configuration operation can be performed by storing a first sequence of operation steps which define a first depth sensing mode of operation, and a second sequence of operation steps which define a second depth sensing mode of operation, in the memory. In response to a first request for depth measurements according to the first depth sensing mode of operation, the depth sensor can be operated in the first mode of operation by causing it to execute the first sequence of operation steps. In response to a second request for depth measurements according to the second depth sensing mode of operation, and without performing an additional configuration operation, the depth sensor can be operated in the second mode of operation by causing it to execute the second sequence of operation steps.
-
公开(公告)号:US10986270B2
公开(公告)日:2021-04-20
申请号:US16445060
申请日:2019-06-18
Applicant: Magic Leap, Inc.
Inventor: Brian Keith Smith , Carlos A. Rivera Cintron , Jose Felix Rodriguez , Matthew Thomas Hull , Gregory Michael Link
IPC: H04N5/232 , G06T7/246 , G09G5/00 , G02B27/01 , H04N13/279 , H04N13/344 , G06F3/03 , G06F1/16 , G06F1/3234 , G06F3/01 , G02B27/00
Abstract: A head mounted display system can process images by assessing relative motion between the head mounted display and one or more features in a user's environment. The assessment of relative motion can include determining whether the head mounted display has moved, is moving and/or is expected to move with respect to one or more features in the environment. Additionally or alternatively, the assessment can include determining whether one or more features in the environment have moved, are moving and/or are expected to move relative to the head mounted display. The image processing can further include determining one or more virtual image content locations in the environment that correspond to a location where renderable virtual image content appears to a user when the location appears in the display and comparing the one or more virtual image content locations in the environment with a viewing zone.
-
公开(公告)号:US20200351427A1
公开(公告)日:2020-11-05
申请号:US16879468
申请日:2020-05-20
Applicant: Magic Leap, Inc.
Inventor: Brian Keith Smith , Ilya Tsunaev
Abstract: Provided are methods, systems, and computer-program products for determining one or more settings of a content capture device. In some examples, to determine the one or more settings, luma values of pixels of an image from the content capture device may be identified. Objects in the image and information associated with the objects may also be identified. The information associated with the objects may be divided into categories of the information. And using the objects and the information, a separate weight array for each category of the information may be computed. The separate weight arrays may be combined to create a total weight array to augment the luma values. The augmented luma values may be aggregated to compute a weighted luma average for the image. Based upon a difference of the weighted luma average and a target, the one or more settings may be adjusted.
-
公开(公告)号:US12219265B2
公开(公告)日:2025-02-04
申请号:US18601406
申请日:2024-03-11
Applicant: Magic Leap, Inc.
Inventor: Brian Keith Smith , Ilya Tsunaev
IPC: H04N23/72 , H04N5/222 , H04N5/265 , H04N23/71 , H04N23/73 , H04N23/741 , H04N23/743 , H04N23/76 , H04N23/63
Abstract: A method includes receiving a first image captured by a content capture device included in a mixed reality or augmented reality device, identifying a location corresponding to a pixel group of a plurality of pixel groups in the first image, and determining, for each location, one or more updates for one or more settings of the content capture device. The method also includes iteratively: updating the content capture device using an update of the one or more updates, capturing an image of a predetermined number of images using the content capture device and the update of the one or more updates, and repeating updating the content capture device and capturing the image the predetermined number of times. The method also includes stitching the predetermined number of images together to form a composite image.
-
公开(公告)号:US12192623B2
公开(公告)日:2025-01-07
申请号:US18453762
申请日:2023-08-22
Applicant: Magic Leap, Inc.
Inventor: Brian Keith Smith , Koon Keong Shee , Gregory Michael Link
IPC: H04N23/667 , G01S17/894 , G06F3/00 , H04N13/139 , H04N13/296 , H04N23/959
Abstract: A system and method for operating a depth sensor. A configuration operation can be performed by storing a first sequence of operation steps which define a first depth sensing mode of operation, and a second sequence of operation steps which define a second depth sensing mode of operation, in the memory. In response to a first request for depth measurements according to the first depth sensing mode of operation, the depth sensor can be operated in the first mode of operation by causing it to execute the first sequence of operation steps. In response to a second request for depth measurements according to the second depth sensing mode of operation, and without performing an additional configuration operation, the depth sensor can be operated in the second mode of operation by causing it to execute the second sequence of operation steps.
-
-
-
-
-
-
-
-
-