公开(公告)号：US11494990B2

公开(公告)日：2022-11-08

申请号：US16620264

申请日：2019-10-07

Applicant: Google LLC

Inventor： Bryan Woods ,  Jianing Wei ,  Sundeep Vaddadi ,  Cheng Yang ,  Konstantine Tsotsos ,  Keith Schaefer ,  Leon Wong ,  Keir Banks Mierle ,  Matthias Grundmann

IPC: G06T19/00 ,  G06F3/04815 ,  G06T19/20

Abstract: In a general aspect, a method can include receiving data defining an augmented reality (AR) environment including a representation of a physical environment, and changing tracking of an AR object within the AR environment between region-tracking mode and plane-tracking mode.

公开(公告)号：US11436755B2

公开(公告)日：2022-09-06

申请号：US16988683

申请日：2020-08-09

Applicant: Google LLC

Inventor： Tingbo Hou ,  Matthias Grundmann ,  Liangkai Zhang ,  Jianing Wei ,  Adel Ahmadyan

IPC: G06T7/73 ,  G06T7/11

Abstract: Example embodiments allow for fast, efficient determination of bounding box vertices or other pose information for objects based on images of a scene that may contain the objects. An artificial neural network or other machine learning algorithm is used to generate, from an input image, a heat map and a number of pairs of displacement maps. The location of a peak within the heat map is then used to extract, from the displacement maps, the two-dimensional displacement, from the location of the peak within the image, of vertices of a bounding box that contains the object. This bounding box can then be used to determine the pose of the object within the scene. The artificial neural network can be configured to generate intermediate segmentation maps, coordinate maps, or other information about the shape of the object so as to improve the estimated bounding box.

公开(公告)号：US10200613B2

公开(公告)日：2019-02-05

申请号：US15848289

申请日：2017-12-20

Applicant: Google LLC

Inventor： Chia-Kai Liang ,  Xue Tu ,  Lun-Cheng Chu ,  Jianing Wei

IPC: H04N5/228 ,  H04N5/232 ,  G06T7/20

Abstract: The disclosed technology includes techniques for providing improved video stabilization on a mobile device. Using gyroscope data of the mobile device, the physical camera orientation of the mobile device may be estimated over time. Using the physical camera orientation and historical data, corresponding virtual camera orientations representing a camera orientation with undesired rotational movement removed may be modeled using a non-linear filter to provide for mapping of a real image to a stabilized virtual image. The virtual camera orientation may be modified to prevent undefined pixels from appearing in the output image.

公开(公告)号：US20180115714A1

公开(公告)日：2018-04-26

申请号：US15848289

申请日：2017-12-20

Applicant: Google LLC

Inventor： Chia-Kai Liang ,  Xue Tu ,  Lun-Cheng Chu ,  Jianing Wei

IPC: H04N5/232

CPC classification number: H04N5/23267 ,  G06T7/20 ,  H04N5/23248 ,  H04N5/23258 ,  H04N5/23261 ,  H04N5/23264 ,  H04N5/2329

Abstract: The disclosed technology includes techniques for providing improved video stabilization on a mobile device. Using gyroscope data of the mobile device, the physical camera orientation of the mobile device may be estimated over time. Using the physical camera orientation and historical data, corresponding virtual camera orientations representing a camera orientation with undesired rotational movement removed may be modeled using a non-linear filter to provide for mapping of a real image to a stabilized virtual image. The virtual camera orientation may be modified to prevent undefined pixels from appearing in the output image.