-
公开(公告)号:US10937182B2
公开(公告)日:2021-03-02
申请号:US15994471
申请日:2018-05-31
Applicant: Google LLC
Inventor: Mingsong Dou , Sean Ryan Fanello , Adarsh Prakash Murthy Kowdle , Christoph Rhemann , Sameh Khamis , Philip L. Davidson , Shahram Izadi , Vladimir Tankovich
Abstract: An electronic device estimates a pose of one or more subjects in an environment based on estimating a correspondence between a data volume containing a data mesh based on a current frame captured by a depth camera and a reference volume containing a plurality of fused prior data frames based on spectral embedding and performing bidirectional non-rigid matching between the reference volume and the current data frame to refine the correspondence so as to support location-based functionality. The electronic device predicts correspondences between the data volume and the reference volume based on spectral embedding. The correspondences provide constraints that accelerate the convergence between the data volume and the reference volume. By tracking changes between the current data mesh frame and the reference volume, the electronic device avoids tracking failures that can occur when relying solely on a previous data mesh frame.
-
公开(公告)号:US10554957B2
公开(公告)日:2020-02-04
申请号:US15996880
申请日:2018-06-04
Applicant: Google LLC
Inventor: Julien Pascal Christophe Valentin , Sean Ryan Fanello , Adarsh Prakash Murthy Kowdle , Christoph Rhemann , Vladimir Tankovich , Philip L. Davidson , Shahram Izadi
IPC: G06K9/64 , H04N13/271 , H04N19/597 , H04N13/128 , G06K9/62 , G06T7/593 , H04N13/00
Abstract: A first and second image of a scene are captured. Each of a plurality of pixels in the first image is associated with a disparity value. An image patch associated with each of the plurality of pixels of the first image and the second image is mapped into a binary vector. Thus, values of pixels in an image are mapped to a binary space using a function that preserves characteristics of values of the pixels. The difference between the binary vector associated with each of the plurality of pixels of the first image and its corresponding binary vector in the second image designated by the disparity value associated with each of the plurality of pixels of the first image is determined. Based on the determined difference between binary vectors, correspondence between the plurality of pixels of the first image and the second image is established.
-
公开(公告)号:US20180352213A1
公开(公告)日:2018-12-06
申请号:US15996880
申请日:2018-06-04
Applicant: Google LLC
Inventor: Julien Pascal Christophe Valentin , Sean Ryan Fanello , Adarsh Prakash Murthy Kowdle , Christoph Rhemann , Vladimir Tankovich , Philip L. Davidson , Shahram Izadi
IPC: H04N13/271 , H04N19/597 , G06K9/62 , H04N13/128
CPC classification number: H04N13/271 , G06K9/6268 , G06T7/593 , G06T2207/20081 , H04N13/128 , H04N19/597 , H04N2013/0081
Abstract: A first and second image of a scene are captured. Each of a plurality of pixels in the first image is associated with a disparity value. An image patch associated with each of the plurality of pixels of the first image and the second image is mapped into a binary vector. Thus, values of pixels in an image are mapped to a binary space using a function that preserves characteristics of values of the pixels. The difference between the binary vector associated with each of the plurality of pixels of the first image and its corresponding binary vector in the second image designated by the disparity value associated with each of the plurality of pixels of the first image is determined. Based on the determined difference between binary vectors, correspondence between the plurality of pixels of the first image and the second image is established.
-
公开(公告)号:US11037026B2
公开(公告)日:2021-06-15
申请号:US16749626
申请日:2020-01-22
Applicant: Google LLC
Inventor: Sean Ryan Fanello , Julien Pascal Christophe Valentin , Adarsh Prakash Murthy Kowdle , Christoph Rhemann , Vladimir Tankovich , Philip L. Davidson , Shahram Izadi
IPC: G06K9/62
Abstract: Values of pixels in an image are mapped to a binary space using a first function that preserves characteristics of values of the pixels. Labels are iteratively assigned to the pixels in the image in parallel based on a second function. The label assigned to each pixel is determined based on values of a set of nearest-neighbor pixels. The first function is trained to map values of pixels in a set of training images to the binary space and the second function is trained to assign labels to the pixels in the set of training images. Considering only the nearest neighbors in the inference scheme results in a computational complexity that is independent of the size of the solution space and produces sufficient approximations of the true distribution when the solution for each pixel is most likely found in a small subset of the set of potential solutions.
-
公开(公告)号:US10579905B2
公开(公告)日:2020-03-03
申请号:US15925141
申请日:2018-03-19
Applicant: Google LLC
Inventor: Sean Ryan Fanello , Julien Pascal Christophe Valentin , Adarsh Prakash Murthy Kowdle , Christoph Rhemann , Vladimir Tankovich , Philip L. Davidson , Shahram Izadi
IPC: G06K9/62
Abstract: Values of pixels in an image are mapped to a binary space using a first function that preserves characteristics of values of the pixels. Labels are iteratively assigned to the pixels in the image in parallel based on a second function. The label assigned to each pixel is determined based on values of a set of nearest-neighbor pixels. The first function is trained to map values of pixels in a set of training images to the binary space and the second function is trained to assign labels to the pixels in the set of training images. Considering only the nearest neighbors in the inference scheme results in a computational complexity that is independent of the size of the solution space and produces sufficient approximations of the true distribution when the solution for each pixel is most likely found in a small subset of the set of potential solutions.
-
-
-
-