公开(公告)号：US11145075B2

公开(公告)日：2021-10-12

申请号：US16767401

申请日：2019-10-04

Applicant: Google LLC

Inventor： Julien Valentin ,  Onur G. Guleryuz ,  Mira Leung ,  Maksym Dzitsiuk ,  Jose Pascoal ,  Mirko Schmidt ,  Christoph Rhemann ,  Neal Wadhwa ,  Eric Turner ,  Sameh Khamis ,  Adarsh Prakash Murthy Kowdle ,  Ambrus Csaszar ,  João Manuel Castro Afonso ,  Jonathan T. Barron ,  Michael Schoenberg ,  Ivan Dryanovski ,  Vivek Verma ,  Vladimir Tankovich ,  Shahram Izadi ,  Sean Ryan Francesco Fanello ,  Konstantine Nicholas John Tsotsos

IPC: G06T7/579 ,  G06T19/00 ,  G06T7/571

Abstract: A handheld user device includes a monocular camera to capture a feed of images of a local scene and a processor to select, from the feed, a keyframe and perform, for a first image from the feed, stereo matching using the first image, the keyframe, and a relative pose based on a pose associated with the first image and a pose associated with the keyframe to generate a sparse disparity map representing disparities between the first image and the keyframe. The processor further is to determine a dense depth map from the disparity map using a bilateral solver algorithm, and process a viewfinder image generated from a second image of the feed with occlusion rendering based on the depth map to incorporate one or more virtual objects into the viewfinder image to generate an AR viewfinder image. Further, the processor is to provide the AR viewfinder image for display.

公开(公告)号：US10803663B2

公开(公告)日：2020-10-13

申请号：US15666763

申请日：2017-08-02

Applicant: GOOGLE LLC

Inventor： Zhaoguang Wang ,  Mugur Marculescu ,  Chris McKenzie ,  Ambrus Csaszar ,  Ivan Dryanovski

IPC: G06T19/00 ,  H04N13/25 ,  H04N13/271 ,  H04N13/239 ,  G06F3/0481 ,  G06F3/01 ,  G06T19/20 ,  H04N13/344 ,  H04N13/00

Abstract: A method for depth sensor aided estimation of virtual reality environment boundaries includes generating depth data at a depth sensor of an electronic device based on a local environment proximate the electronic device. A set of initial boundary data is estimated based on the depth data, wherein the set of initial boundary data defines an exterior boundary of a virtual bounded floor plan. The virtual bounded floor plan is generated based at least in part on the set of initial boundary data. Additionally, a relative pose of the electronic device within the virtual bounded floor plan is determined and a collision warning is displayed on a display of the electronic device based on the relative pose.

公开(公告)号：US20230186575A1

公开(公告)日：2023-06-15

申请号：US17998903

申请日：2020-05-22

Applicant: GOOGLE LLC

Inventor： Eric Turner ,  Keisuke Tateno ,  Konstantine Nicholas John Tsotsos ,  Adarsh Prakash Murthy Kowdle ,  Vaibhav Gupta ,  Ambrus Csaszar

IPC: G06T19/00 ,  G06T1/60

CPC classification number: G06T19/006 ,  G06T1/60

Abstract: A method including receiving a first depth image associated with a first frame at a first time of an augmented reality (AR) application, the first depth image representing at least a first portion of a real-world space storing the first depth image receiving a second depth image associated with a second frame at a second time, after the first time, of the AR application, the second depth image representing at least a second portion of the real-world space generating a real-world image by blending, at least, the stored first depth image with the second depth image receiving a rendered AR object combining the AR object in the real-world image and displaying the real-world image combined with the AR object.