-
公开(公告)号:US11775835B2
公开(公告)日:2023-10-03
申请号:US16844812
申请日:2020-04-09
申请人: Magic Leap, Inc.
IPC分类号: G06N3/084 , G06N3/04 , G06V20/00 , G06V10/44 , G06V10/94 , G06V20/20 , G06F18/214 , G06F18/2413 , G06N3/044 , G06N3/045 , G06V10/764 , G06V10/774 , G06V10/82 , G06N3/082
CPC分类号: G06N3/084 , G06F18/214 , G06F18/2413 , G06N3/04 , G06N3/044 , G06N3/045 , G06V10/44 , G06V10/454 , G06V10/764 , G06V10/774 , G06V10/82 , G06V10/95 , G06V20/20 , G06V20/36 , G06N3/082
摘要: Systems and methods for estimating a layout of a room are disclosed. The room layout can comprise the location of a floor, one or more walls, and a ceiling. In one aspect, a neural network can analyze an image of a portion of a room to determine the room layout. The neural network can comprise a convolutional neural network having an encoder sub-network, a decoder sub-network, and a side sub-network. The neural network can determine a three-dimensional room layout using two-dimensional ordered keypoints associated with a room type. The room layout can be used in applications such as augmented or mixed reality, robotics, autonomous indoor navigation, etc.
-
公开(公告)号:US11600049B2
公开(公告)日:2023-03-07
申请号:US16856980
申请日:2020-04-23
申请人: Magic Leap, Inc.
摘要: Techniques for estimating a perimeter of a room environment at least partially enclosed by a set of adjoining walls using posed images are disclosed. A set of images and a set of poses are obtained. A depth map is generated based on the set of images and the set of poses. A set of wall segmentation maps are generated based on the set of images, each of the set of wall segmentation maps indicating a target region of a corresponding image that contains the set of adjoining walls. A point cloud is generated based on the depth map and the set of wall segmentation maps, the point cloud including a plurality of points that are sampled along portions of the depth map that align with the target region. The perimeter of the environment along the set of adjoining walls is estimated based on the point cloud.
-
公开(公告)号:US20220020192A1
公开(公告)日:2022-01-20
申请号:US17385724
申请日:2021-07-26
申请人: Magic Leap, Inc.
摘要: A wearable device can include an inward-facing imaging system configured to acquire images of a user's periocular region. The wearable device can determine a relative position between the wearable device and the user's face based on the images acquired by the inward-facing imaging system. The relative position may be used to determine whether the user is wearing the wearable device, whether the wearable device fits the user, or whether an adjustment to a rendering location of virtual object should be made to compensate for a deviation of the wearable device from its normal resting position.
-
公开(公告)号:US11100692B2
公开(公告)日:2021-08-24
申请号:US16780698
申请日:2020-02-03
申请人: Magic Leap, Inc.
摘要: A wearable device can include an inward-facing imaging system configured to acquire images of a user's periocular region. The wearable device can determine a relative position between the wearable device and the user's face based on the images acquired by the inward-facing imaging system. The relative position may be used to determine whether the user is wearing the wearable device, whether the wearable device fits the user, or whether an adjustment to a rendering location of virtual object should be made to compensate for a deviation of the wearable device from its normal resting position.
-
公开(公告)号:US20200342674A1
公开(公告)日:2020-10-29
申请号:US16856980
申请日:2020-04-23
申请人: Magic Leap, Inc.
摘要: Techniques for estimating a perimeter of a room environment at least partially enclosed by a set of adjoining walls using posed images are disclosed. A set of images and a set of poses are obtained. A depth map is generated based on the set of images and the set of poses. A set of wall segmentation maps are generated based on the set of images, each of the set of wall segmentation maps indicating a target region of a corresponding image that contains the set of adjoining walls. A point cloud is generated based on the depth map and the set of wall segmentation maps, the point cloud including a plurality of points that are sampled along portions of the depth map that align with the target region. The perimeter of the environment along the set of adjoining walls is estimated based on the point cloud.
-
公开(公告)号:US10657376B2
公开(公告)日:2020-05-19
申请号:US15923511
申请日:2018-03-16
申请人: Magic Leap, Inc.
摘要: Systems and methods for estimating a layout of a room are disclosed. The room layout can comprise the location of a floor, one or more walls, and a ceiling. In one aspect, a neural network can analyze an image of a portion of a room to determine the room layout. The neural network can comprise a convolutional neural network having an encoder sub-network, a decoder sub-network, and a side sub-network. The neural network can determine a three-dimensional room layout using two-dimensional ordered keypoints associated with a room type. The room layout can be used in applications such as augmented or mixed reality, robotics, autonomous indoor navigation, etc.
-
公开(公告)号:US10445881B2
公开(公告)日:2019-10-15
申请号:US15605567
申请日:2017-05-25
申请人: Magic Leap, Inc.
IPC分类号: G06T7/00 , G06T7/10 , G06K9/00 , G06T7/12 , G06T7/194 , G06T7/11 , G06K9/03 , G06K9/46 , G06K9/62
摘要: Systems and methods for eye image segmentation and image quality estimation are disclosed. In one aspect, after receiving an eye image, a device such as an augmented reality device can process the eye image using a convolutional neural network with a merged architecture to generate both a segmented eye image and a quality estimation of the eye image. The segmented eye image can include a background region, a sclera region, an iris region, or a pupil region. In another aspect, a convolutional neural network with a merged architecture can be trained for eye image segmentation and image quality estimation. In yet another aspect, the device can use the segmented eye image to determine eye contours such as a pupil contour and an iris contour. The device can use the eye contours to create a polar image of the iris region for computing an iris code or biometric authentication.
-
公开(公告)号:US11906742B2
公开(公告)日:2024-02-20
申请号:US17385724
申请日:2021-07-26
申请人: Magic Leap, Inc.
IPC分类号: G02B27/01 , G06T3/20 , G06T11/60 , G06V10/46 , G06V40/19 , G06V40/16 , G06V40/18 , G06V20/20
CPC分类号: G02B27/0172 , G02B27/0179 , G06T3/20 , G06T11/60 , G06V10/462 , G06V20/20 , G06V40/165 , G06V40/166 , G06V40/171 , G06V40/19 , G06V40/193 , G06V40/197 , G02B2027/014 , G02B2027/0127 , G02B2027/0134 , G02B2027/0138 , G02B2027/0178 , G02B2027/0181 , G02B2027/0187
摘要: A wearable device can include an inward-facing imaging system configured to acquire images of a user's periocular region. The wearable device can determine a relative position between the wearable device and the user's face based on the images acquired by the inward-facing imaging system. The relative position may be used to determine whether the user is wearing the wearable device, whether the wearable device fits the user, or whether an adjustment to a rendering location of virtual object should be made to compensate for a deviation of the wearable device from its normal resting position.
-
公开(公告)号:US11775058B2
公开(公告)日:2023-10-03
申请号:US17129669
申请日:2020-12-21
申请人: Magic Leap, Inc.
CPC分类号: G06F3/013 , G06N3/08 , G06T7/0012 , G06T7/11 , G06V10/764 , G06V10/82 , G06V40/18 , G06V40/19 , G06T2207/20081 , G06T2207/20084 , G06T2207/30041
摘要: Systems and methods for estimating a gaze vector of an eye using a trained neural network. An input image of the eye may be received from a camera. The input image may be provided to the neural network. Network output data may be generated using the neural network. The network output data may include two-dimensional (2D) pupil data, eye segmentation data, and/or cornea center data. The gaze vector may be computed based on the network output data. The neural network may be previously trained by providing a training input image to the neural network, generating training network output data, receiving ground-truth (GT) data, computing error data based on a difference between the training network output data and the GT data, and modifying the neural network based on the error data.
-
公开(公告)号:US11128854B2
公开(公告)日:2021-09-21
申请号:US16352522
申请日:2019-03-13
申请人: Magic Leap, Inc.
IPC分类号: G06K9/00 , H04N13/271 , H04N13/128 , G06T7/593 , H04N13/00 , G06T19/00
摘要: Systems and methods are disclosed for computing depth maps. One method includes capturing, using a camera, a camera image of a runtime scene. The method may also include analyzing the camera image of the runtime scene to determine a plurality of target sampling points at which to capture depth of the runtime scene. The method may further include adjusting a setting associated with a low-density depth sensor based on the plurality of target sampling points. The method may further include capturing, using the low-density depth sensor, a low-density depth map of the runtime scene at the plurality of target sampling points. The method may further include generating a computed depth map of the runtime scene based on the camera image of the runtime scene and the low-density depth map of the runtime scene.
-
-
-
-
-
-
-
-
-