公开(公告)号：US11676296B2

公开(公告)日：2023-06-13

申请号：US16101201

申请日：2018-08-10

Applicant: SRI International

Inventor： Han-Pang Chiu ,  Supun Samarasekera ,  Rakesh Kumar ,  Ryan Villamil ,  Varun Murali ,  Gregory Drew Kessler

IPC: G06T7/579 ,  G06T19/00 ,  G06T7/136 ,  G06N3/08 ,  G06F16/903 ,  G06F16/583 ,  G06T7/521 ,  G06T7/143 ,  G06T7/11 ,  G06V20/58 ,  G06V20/56 ,  G06F18/24 ,  G06V20/20 ,  G01S17/89 ,  G01S17/86

CPC classification number: G06T7/579 ,  G06F16/5838 ,  G06F16/903 ,  G06F18/24 ,  G06N3/08 ,  G06T7/11 ,  G06T7/136 ,  G06T7/143 ,  G06T7/521 ,  G06T19/006 ,  G06V20/20 ,  G06V20/56 ,  G06V20/582 ,  G06V20/588 ,  G01S17/86 ,  G01S17/89 ,  G06T2207/10016 ,  G06T2207/10021 ,  G06T2207/10028 ,  G06T2207/10032 ,  G06T2207/30212 ,  G06T2207/30244 ,  G06T2207/30248

Abstract: Techniques for augmenting a reality captured by an image capture device are disclosed. In one example, a system includes an image capture device that generates a two-dimensional frame at a local pose. The system further includes a computation engine executing on one or more processors that queries, based on an estimated pose prior, a reference database of three-dimensional mapping information to obtain an estimated view of the three-dimensional mapping information at the estimated pose prior. The computation engine processes the estimated view at the estimated pose prior to generate semantically segmented sub-views of the estimated view. The computation engine correlates, based on at least one of the semantically segmented sub-views of the estimated view, the estimated view to the two-dimensional frame. Based on the correlation, the computation engine generates and outputs data for augmenting a reality represented in at least one frame captured by the image capture device.

公开(公告)号：US20190051056A1

公开(公告)日：2019-02-14

申请号：US16101201

申请日：2018-08-10

Applicant: SRI International

Inventor： Han-Pang Chiu ,  Supun Samarasekera ,  Rakesh Kumar ,  Ryan Villamil ,  Varun Murali ,  Gregory Drew Kessler

IPC: G06T19/00 ,  G06K9/62 ,  G06T7/136 ,  G06F17/30 ,  G06K9/00 ,  G06N3/08 ,  G01S17/89

Abstract: Techniques for augmenting a reality captured by an image capture device are disclosed. In one example, a system includes an image capture device that generates a two-dimensional frame at a local pose. The system further includes a computation engine executing on one or more processors that queries, based on an estimated pose prior, a reference database of three-dimensional mapping information to obtain an estimated view of the three-dimensional mapping information at the estimated pose prior. The computation engine processes the estimated view at the estimated pose prior to generate semantically segmented sub-views of the estimated view. The computation engine correlates, based on at least one of the semantically segmented sub-views of the estimated view, the estimated view to the two-dimensional frame. Based on the correlation, the computation engine generates and outputs data for augmenting a reality represented in at least one frame captured by the image capture device.