-
公开(公告)号：US11989900B2
公开(公告)日：2024-05-21
申请号：US17357118
申请日：2021-06-24
Applicant: Magic Leap, Inc.
Inventor： Siddharth Mahendran , Nitin Bansal , Nitesh Sekhar , Manushree Gangwar , Khushi Gupta , Prateek Singhal
IPC: G06T7/73 , G06F18/21 , G06F18/24 , G06N3/04 , G06T7/579 , G06T7/60 , G06T19/00 , G06V10/44 , G06V20/20 , G06V20/64
CPC classification number: G06T7/579 , G06F18/2163 , G06F18/24 , G06N3/04 , G06T7/60 , G06T7/73 , G06T19/006 , G06V10/454 , G06V20/20 , G06V20/647 , G06T2207/20084
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for object recognition neural network for amodal center prediction. One of the methods includes receiving an image of an object captured by a camera. The image of the object is processed using an object recognition neural network that is configured to generate an object recognition output. The object recognition output includes data defining a predicted two-dimensional amodal center of the object, wherein the predicted two-dimensional amodal center of the object is a projection of a predicted three-dimensional center of the object under a camera pose of the camera that captured the image.
-
公开(公告)号：US11978159B2
公开(公告)日：2024-05-07
申请号：US17542306
申请日：2021-12-03
Applicant: Magic Leap, Inc.
Inventor： Anush Mohan , Rafael Domingos Torres , Daniel Olshansky , Samuel A. Miller , Jehangir Tajik , Joel David Holder , Jeremy Dwayne Miranda , Robert Blake Taylor , Ashwin Swaminathan , Lomesh Agarwal , Hiral Honar Barot , Helder Toshiro Suzuki , Ali Shahrokni , Eran Guendelman , Prateek Singhal , Xuan Zhao , Siddharth Choudhary , Nicholas Atkinson Kramer , Kenneth William Tossell , Christian Ivan Robert Moore
CPC classification number: G06T17/05 , G06F3/012 , G06F16/29 , G06T7/74 , G06T19/006 , G06T2207/20216 , H04L67/01
Abstract: A cross reality system that provides an immersive user experience by storing persistent spatial information about the physical world that one or multiple user devices can access to determine position within the physical world and that applications can access to specify the position of virtual objects within the physical world. Persistent spatial information enables users to have a shared virtual, as well as physical, experience when interacting with the cross reality system. Further, persistent spatial information may be used in maps of the physical world, enabling one or multiple devices to access and localize into previously stored maps, reducing the need to map a physical space before using the cross reality system in it. Persistent spatial information may be stored as persistent coordinate frames, which may include a transformation relative to a reference orientation and information derived from images in a location corresponding to the persistent coordinate frame.
-
公开(公告)号：US20210209859A1
公开(公告)日：2021-07-08
申请号：US17208844
申请日：2021-03-22
Applicant: Magic Leap, Inc.
Inventor： Jeremy Dwayne Miranda , Rafael Domingos Torres , Daniel Olshansky , Anush Mohan , Robert Blake Taylor , Samuel A. Miller , Jehangir Tajik , Ashwin Swaminathan , Lomesh Agarwal , Ali Shahrokni , Prateek Singhal , Joel David Holder , Xuan Zhao , Siddharth Choudhary , Helder Toshiro Suzuki , Hiral Honar Barot , Eran Guendelman , Michael Harold Liebenow , Christian Ivan Robert Moore
Abstract: An augmented reality viewing system is described. A local coordinate frame of local content is transformed to a world coordinate frame. A further transformation is made to a head coordinate frame and a further transformation is made to a camera coordinate frame that includes all pupil positions of an eye. One or more users may interact in separate sessions with a viewing system. If a canonical map is available, the earlier map is downloaded onto a viewing device of a user. The viewing device then generates another map and localizes the subsequent map to the canonical map.
-
公开(公告)号：US20200051328A1
公开(公告)日：2020-02-13
申请号：US16593745
申请日：2019-10-04
Applicant: Magic Leap, Inc.
Inventor： Anush Mohan , Rafael Domingos Torres , Daniel Olshansky , Samuel A. Miller , Jehangir Tajik , Joel David Holder , Jeremy Dwayne Miranda , Robert Blake Taylor , Ashwin Swaminathan , Lomesh Agarwal , Hiral Honar Barot , Helder Toshiro Suzuki , Ali Shahrokni , Eran Guendelman , Prateek Singhal , Xuan Zhao , Siddharth Choudhary , Nick Kramer , Ken Tossell
Abstract: A cross reality system that provides an immersive user experience by storing persistent spatial information about the physical world that one or multiple user devices can access to determine position within the physical world and that applications can access to specify the position of virtual objects within the physical world. Persistent spatial information enables users to have a shared virtual, as well as physical, experience when interacting with the cross reality system. Further, persistent spatial information may be used in maps of the physical world, enabling one or multiple devices to access and localize into previously stored maps, reducing the need to map a physical space before using the cross reality system in it. Persistent spatial information may be stored as persistent coordinate frames, which may include a transformation relative to a reference orientation and information derived from images in a location corresponding to the persistent coordinate frame.
-
公开(公告)号：US12211271B2
公开(公告)日：2025-01-28
申请号：US18378086
申请日：2023-10-09
Applicant: Magic Leap, Inc.
Inventor： Martin Georg Zahnert , Joao Antonio Pereira Faro , Miguel Andres Granados Velasquez , Dominik Michael Kasper , Ashwin Swaminathan , Anush Mohan , Prateek Singhal
Abstract: To determine the head pose of a user, a head-mounted display system having an imaging device can obtain a current image of a real-world environment, with points corresponding to salient points which will be used to determine the head pose. The salient points are patch-based and include: a first salient point being projected onto the current image from a previous image, and with a second salient point included in the current image being extracted from the current image. Each salient point is subsequently matched with real-world points based on descriptor-based map information indicating locations of salient points in the real-world environment. The orientation of the imaging devices is determined based on the matching and based on the relative positions of the salient points in the view captured in the current image. The orientation may be used to extrapolate the head pose of the wearer of the head-mounted display system.
-
Patent Agency Ranking
6.发明授权公开(公告)号：US11687151B2
公开(公告)日：2023-06-27
申请号：US17500798
申请日：2021-10-13
Applicant: MAGIC LEAP, INC.
Inventor： Divya Sharma , Ali Shahrokni , Anush Mohan , Prateek Singhal , Xuan Zhao , Sergiu Sima , Benjamin Langmann
CPC classification number: G06F3/011 , G06F1/163 , G06T15/005 , G06T19/006 , G06V20/20
Abstract: An apparatus configured to be worn on a head of a user, includes: a screen configured to present graphics to the user; a camera system configured to view an environment in which the user is located; and a processing unit configured to determine a map based at least in part on output(s) from the camera system, wherein the map is configured for use by the processing unit to localize the user with respect to the environment; wherein the processing unit of the apparatus is also configured to obtain a metric indicating a likelihood of success to localize the user using the map, and wherein the processing unit is configured to obtain the metric by computing the metric or by receiving the metric.
-
公开(公告)号：US11501529B2
公开(公告)日：2022-11-15
申请号：US17193568
申请日：2021-03-05
Applicant: Magic Leap, Inc.
Inventor： Martin Georg Zahnert , Joao Antonio Pereira Faro , Miguel Andres Granados Velasquez , Dominik Michael Kasper , Ashwin Swaminathan , Anush Mohan , Prateek Singhal
Abstract: To determine the head pose of a user, a head-mounted display system having an imaging device can obtain a current image of a real-world environment, with points corresponding to salient points which will be used to determine the head pose. The salient points are patch-based and include: a first salient point being projected onto the current image from a previous image, and with a second salient point included in the current image being extracted from the current image. Each salient point is subsequently matched with real-world points based on descriptor-based map information indicating locations of salient points in the real-world environment. The orientation of the imaging devices is determined based on the matching and based on the relative positions of the salient points in the view captured in the current image. The orientation may be used to extrapolate the head pose of the wearer of the head-mounted display system.
-
公开(公告)号：US20210334537A1
公开(公告)日：2021-10-28
申请号：US17193568
申请日：2021-03-05
Applicant: Magic Leap, Inc.
Inventor： Martin Georg Zahnert , Joao Antonio Pereira Faro , Miguel Andres Granados Velasquez , Dominik Michael Kasper , Ashwin Swaminathan , Anush Mohan , Prateek Singhal
IPC: G06K9/00 , G02B27/01 , G06F3/01 , G06F3/0481
Abstract: To determine the head pose of a user, a head-mounted display system having an imaging device can obtain a current image of a real-world environment, with points corresponding to salient points which will be used to determine the head pose. The salient points are patch-based and include: a first salient point being projected onto the current image from a previous image, and with a second salient point included in the current image being extracted from the current image. Each salient point is subsequently matched with real-world points based on descriptor-based map information indicating locations of salient points in the real-world environment. The orientation of the imaging devices is determined based on the matching and based on the relative positions of the salient points in the view captured in the current image. The orientation may be used to extrapolate the head pose of the wearer of the head-mounted display system.
-
9.发明授权公开(公告)号：US12079382B2
公开(公告)日：2024-09-03
申请号：US18314289
申请日：2023-05-09
Applicant: MAGIC LEAP, INC.
Inventor： Divya Sharma , Ali Shahrokni , Anush Mohan , Prateek Singhal , Xuan Zhao , Sergiu Sima , Benjamin Langmann
CPC classification number: G06F3/011 , G06F1/163 , G06T15/005 , G06T19/006 , G06V20/20
Abstract: An apparatus configured to be worn on a head of a user, includes: a screen configured to present graphics to the user; a camera system configured to view an environment in which the user is located; and a processing unit configured to determine a map based at least in part on output(s) from the camera system, wherein the map is configured for use by the processing unit to localize the user with respect to the environment; wherein the processing unit of the apparatus is also configured to obtain a metric indicating a likelihood of success to localize the user using the map, and wherein the processing unit is configured to obtain the metric by computing the metric or by receiving the metric.
-
公开(公告)号：US20240127538A1
公开(公告)日：2024-04-18
申请号：US18275468
申请日：2022-02-03
Applicant: Magic Leap, Inc.
Inventor： Divya Ramnath , Shiyu Dong , Siddharth Choudhary , Siddharth Mahendran , Arumugam Kalai Kannan , Prateek Singhal , Khushi Gupta
CPC classification number: G06T17/20 , G06V20/64 , G06T2210/12
Abstract: This document describes scene understanding for cross reality systems using occupancy grids. In one aspect, a method includes recognizing one or more objects in a model of a physical environment generated using images of the physical environment. For each object, a bounding box is fit around the object. An occupancy grid that includes a multiple cells is generated within the bounding box around the object. A value is assigned to each cell of the occupancy grid based on whether the cell includes a portion of the object. An object representation that includes information describing the occupancy grid for the object is generated. The object representations are sent to one or more devices.
-
-
-
-
-
-
-
-
-
Search Results
28
records
(took 0.019 seconds)
