公开(公告)号：US11748905B2

公开(公告)日：2023-09-05

申请号：US17190327

申请日：2021-03-02

申请人： Magic Leap, Inc.

发明人： Lipu Zhou ,  Ashwin Swaminathan ,  Frank Thomas Steinbruecker ,  Daniel Esteban Koppel

IPC分类号： G06T7/73

CPC分类号： G06T7/74 ,  G06T2207/30244

摘要： A method of efficiently and accurately computing a pose of an image with respect to other image information. The image may be acquired with a camera on a portable device and the other information may be a map, such that the computation of pose localizes the device relative to the map. Such a technique may be applied in a cross reality system to enable devices to efficiently and accurately access previously persisted maps. Localizing with respect to a map may enable multiple cross reality devices to render virtual content at locations specified in relation to those maps, providing an enhanced experience for uses of the system. The method may be used in other devices and for other purposes, such as for navigation of autonomous vehicles.

公开(公告)号：US12100181B2

公开(公告)日：2024-09-24

申请号：US17315741

申请日：2021-05-10

申请人： Magic Leap, Inc.

发明人： Lipu Zhou ,  Frank Thomas Steinbruecker ,  Ashwin Swaminathan ,  Hui Ju ,  Daniel Esteban Koppel ,  Konstantinos Zampogiannis ,  Pooja Piyush Mehta ,  Vinayram Balakumar

IPC分类号： G06T7/73 ,  G06F17/16 ,  G06F17/17 ,  G06T7/00 ,  G06T7/55 ,  G06T7/70

CPC分类号： G06T7/97 ,  G06F17/16 ,  G06F17/175 ,  G06T7/70

摘要： Methods and apparatus for providing a representation of an environment, for example, in an XR system, and any suitable computer vision and robotics applications. A representation of an environment may include one or more planar features. The representation of the environment may be provided by jointly optimizing plane parameters of the planar features and sensor poses that the planar features are observed at. The joint optimization may be based on a reduced matrix and a reduced residual vector in lieu of the Jacobian matrix and the original residual vector.

公开(公告)号：US20240029301A1

公开(公告)日：2024-01-25

申请号：US18353851

申请日：2023-07-17

申请人： Magic Leap, Inc.

发明人： Lipu Zhou ,  Ashwin Swaminathan ,  Frank Thomas Steinbruecker ,  Daniel Esteban Koppel

IPC分类号： G06T7/73

CPC分类号： G06T7/74 ,  G06T2207/30244

摘要： A method of efficiently and accurately computing a pose of an image with respect to other image information. The image may be acquired with a camera on a portable device and the other information may be a map, such that the computation of pose localizes the device relative to the map. Such a technique may be applied in a cross reality system to enable devices to efficiently and accurately access previously persisted maps. Localizing with respect to a map may enable multiple cross reality devices to render virtual content at locations specified in relation to those maps, providing an enhanced experience for uses of the system. The method may be used in other devices and for other purposes, such as for navigation of autonomous vehicles.

公开(公告)号：US12106514B2

公开(公告)日：2024-10-01

申请号：US18353851

申请日：2023-07-17

申请人： Magic Leap, Inc.

发明人： Lipu Zhou ,  Ashwin Swaminathan ,  Frank Thomas Steinbruecker ,  Daniel Esteban Koppel

IPC分类号： G06T7/73

CPC分类号： G06T7/74 ,  G06T2207/30244

摘要： A method of efficiently and accurately computing a pose of an image with respect to other image information. The image may be acquired with a camera on a portable device and the other information may be a map, such that the computation of pose localizes the device relative to the map. Such a technique may be applied in a cross reality system to enable devices to efficiently and accurately access previously persisted maps. Localizing with respect to a map may enable multiple cross reality devices to render virtual content at locations specified in relation to those maps, providing an enhanced experience for uses of the system. The method may be used in other devices and for other purposes, such as for navigation of autonomous vehicles.

公开(公告)号：US20210358173A1

公开(公告)日：2021-11-18

申请号：US17315741

申请日：2021-05-10

申请人： Magic Leap, Inc.

发明人： Lipu Zhou ,  Frank Thomas Steinbruecker ,  Ashwin Swaminathan ,  Hui Ju ,  Daniel Esteban Koppel ,  Konstantinos Zampogiannis ,  Pooja Piyush Mehta ,  Vinayram Balakumar

IPC分类号： G06T7/00 ,  G06T7/70 ,  G06F17/16 ,  G06F17/17

摘要： Methods and apparatus for providing a representation of an environment, for example, in an XR system, and any suitable computer vision and robotics applications. A representation of an environment may include one or more planar features. The representation of the environment may be provided by jointly optimizing plane parameters of the planar features and sensor poses that the planar features are observed at. The joint optimization may be based on a reduced matrix and a reduced residual vector in lieu of the Jacobian matrix and the original residual vector.

公开(公告)号：US20210279909A1

公开(公告)日：2021-09-09

申请号：US17190327

申请日：2021-03-02

申请人： Magic Leap, Inc.

发明人： Lipu Zhou ,  Ashwin Swaminathan ,  Frank Thomas Steinbruecker ,  Daniel Esteban Koppel

IPC分类号： G06T7/73

摘要： A method of efficiently and accurately computing a pose of an image with respect to other image information. The image may be acquired with a camera on a portable device and the other information may be a map, such that the computation of pose localizes the device relative to the map. Such a technique may be applied in a cross reality system to enable devices to efficiently and accurately access previously persisted maps. Localizing with respect to a map may enable multiple cross reality devices to render virtual content at locations specified in relation to those maps, providing an enhanced experience for uses of the system. The method may be used in other devices and for other purposes, such as for navigation of autonomous vehicles.