Invention Grant
- Patent Title: Method and system for performing simultaneous localization and mapping using convolutional image transformation
-
Application No.: US16895878Application Date: 2020-06-08
-
Publication No.: US11238606B2Publication Date: 2022-02-01
- Inventor: Daniel DeTone , Tomasz Jan Malisiewicz , Andrew Rabinovich
- Applicant: Magic Leap, Inc.
- Applicant Address: US FL Plantation
- Assignee: Magic Leap, Inc.
- Current Assignee: Magic Leap, Inc.
- Current Assignee Address: US FL Plantation
- Agency: Kilpatrick Townsend & Stockton LLP
- Main IPC: G06T7/593
- IPC: G06T7/593 ; G06K9/00 ; G06K9/62 ; G06T7/33 ; G06T7/35 ; G06T7/579 ; G06K9/46

Abstract:
Augmented reality devices and methods for computing a homography based on two images. One method may include receiving a first image based on a first camera pose and a second image based on a second camera pose, generating a first point cloud based on the first image and a second point cloud based on the second image, providing the first point cloud and the second point cloud to a neural network, and generating, by the neural network, the homography based on the first point cloud and the second point cloud. The neural network may be trained by generating a plurality of points, determining a 3D trajectory, sampling the 3D trajectory to obtain camera poses viewing the points, projecting the points onto 2D planes, comparing a generated homography using the projected points to the ground-truth homography and modifying the neural network based on the comparison.
Public/Granted literature
Information query