公开(公告)号：US20200029006A1

公开(公告)日：2020-01-23

申请号：US16042479

申请日：2018-07-23

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Nathan Henri Levy ,  Ariel Orfaig ,  Sebastien Derhy ,  Shachaf Amir ,  Yoel Yaffe

IPC: H04N5/235 ,  H04N5/232 ,  G06T7/70

Abstract: Methods, apparatuses, and systems are described for positional tracking (PT) in Augmented Reality (AR) applications. The method may include creating different images for AR preview and PT applications. In some cases, the PT information utilizes key point information. The AR preview and the PT images may be generated simultaneously using time division, space division, split timing, or any combination thereof. This may result in PT with significantly less motion blur. Accordingly, the PT will be more robust, and there will be more good frames available for key components of a PT algorithm (i.e., using visual PT to calibrate the biases of an inertial measurement unit). Thus, the methods and apparatus of the present disclosure may enable more effective management of the trade-off between motion-blur, noise and resolution for PT.

公开(公告)号：US11668571B2

公开(公告)日：2023-06-06

申请号：US17176500

申请日：2021-02-16

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Sebastien Derhy ,  Lior Zamir ,  Nathan Henri Levy

IPC: G01C21/20 ,  G06T7/579 ,  G01C21/00 ,  G06T7/73 ,  A61B1/00 ,  G06V10/75 ,  G06V10/44 ,  G06V20/56 ,  G01C21/16

CPC classification number: G01C21/206 ,  A61B1/000094 ,  G01C21/3848 ,  G06T7/579 ,  G06T7/73 ,  G06V10/44 ,  G06V10/757 ,  G06V20/56 ,  G01C21/16

Abstract: A method for simultaneous localization and mapping (SLAM) employs dual event-based cameras. Event streams from the cameras are processed by an image processing system to stereoscopically detect surface points in an environment, dynamically compute pose of a camera as it moves, and concurrently update a map of the environment. A gradient descent based optimization may be utilized to update the pose for each event or for each small batch of events.

公开(公告)号：US10812730B2

公开(公告)日：2020-10-20

申请号：US16042479

申请日：2018-07-23

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Nathan Henri Levy ,  Ariel Orfaig ,  Sebastien Derhy ,  Shachaf Amir ,  Yoel Yaffe

IPC: H04N5/235 ,  G06T7/70 ,  H04N5/232

Abstract: Methods, apparatuses, and systems are described for positional tracking (PT) in Augmented Reality (AR) applications. The method may include creating different images for AR preview and PT applications. In some cases, the PT information utilizes key point information. The AR preview and the PT images may be generated simultaneously using time division, space division, split timing, or any combination thereof. This may result in PT with significantly less motion blur. Accordingly, the PT will be more robust, and there will be more good frames available for key components of a PT algorithm (i.e., using visual PT to calibrate the biases of an inertial measurement unit). Thus, the methods and apparatus of the present disclosure may enable more effective management of the trade-off between motion-blur, noise and resolution for PT.

公开(公告)号：US10948297B2

公开(公告)日：2021-03-16

申请号：US16030273

申请日：2018-07-09

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Sebastien Derhy ,  Lior Zamir ,  Nathan Henri Levy

IPC: G01C21/16 ,  G06T7/579 ,  G01C21/32

Abstract: A method for simultaneous localization and mapping (SLAM) employs dual event-based cameras. Event streams from the cameras are processed by an image processing system to stereoscopically detect surface points in an environment, dynamically compute pose of a camera as it moves, and concurrently update a map of the environment. A gradient descent based optimization may be utilized to update the pose for each event or for each small batch of events.

公开(公告)号：US10939049B2

公开(公告)日：2021-03-02

申请号：US16994742

申请日：2020-08-17

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Nathan Henri Levy ,  Ariel Orfaig ,  Sebastien Derhy ,  Shachaf Amir ,  Yoel Yaffe

IPC: H04N5/235 ,  H04N5/232 ,  G06T7/70

Abstract: Methods, apparatuses, and systems are described for positional tracking (PT) in Augmented Reality (AR) applications. The method may include creating different images for AR preview and PT applications. In some cases, the PT information utilizes key point information. The AR preview and the PT images may be generated simultaneously using time division, space division, split timing, or any combination thereof. This may result in PT with significantly less motion blur. Accordingly, the PT will be more robust, and there will be more good frames available for key components of a PT algorithm (i.e., using visual PT to calibrate the biases of an inertial measurement unit). Thus, the methods and apparatus of the present disclosure may enable more effective management of the trade-off between motion-blur, noise and resolution for PT.

公开(公告)号：US20200011668A1

公开(公告)日：2020-01-09

申请号：US16030273

申请日：2018-07-09

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Sebastien Derhy ,  Lior Zamir ,  Nathan Henri Levy

IPC: G01C21/16 ,  G01C21/32 ,  G06T7/579

Abstract: A method for simultaneous localization and mapping (SLAM) employs dual event-based cameras. Event streams from the cameras are processed by an image processing system to stereoscopically detect surface points in an environment, dynamically compute pose of a camera as it moves, and concurrently update a map of the environment. A gradient descent based optimization may be utilized to update the pose for each event or for each small batch of events.