-
公开(公告)号：US20220027659A1
公开(公告)日：2022-01-27
申请号：US17309171
申请日：2020-09-21
Applicant: Google LLC
Inventor： Chloe LeGendre , Paul Debevec , Wan-Chun Ma , Rohit Pandey , Sean Ryan Francesco Fanello , Christina Tong
Abstract: Techniques of estimating lighting from portraits includes generating a lighting estimate from a single image of a face based on a machine learning (ML) system using multiple bidirectional reflection distribution functions (BRDFs) as a loss function. In some implementations, the ML system is trained using images of faces formed with HDR illumination computed from LDR imagery. The technical solution includes training a lighting estimation model in a supervised manner using a dataset of portraits and their corresponding ground truth illumination.
-
公开(公告)号：US10671842B2
公开(公告)日：2020-06-02
申请号：US15882309
申请日：2018-01-29
Applicant: Google LLC
Inventor： Shiqi Chen , Rong Liu , Rohit Pandey , Marie White , Xue Wang , Pavlo Pidlypenskyi
Abstract: In at least one aspect, a method can include generating a respective set of training set of images for each label in a handedness model by: receiving the label at an image capturing device, obtaining a set of captured images by recording a pass-through image of a user placing a target object within an overlay of a bounding area animation, the target object corresponding with the label, and associating the label with each image in the set of captured images. The method includes training, using the training images, the handedness model to provide a correct label for an input image.
-
公开(公告)号：US11328486B2
公开(公告)日：2022-05-10
申请号：US16861530
申请日：2020-04-29
Applicant: Google LLC
Inventor： Anastasia Tkach , Ricardo Martin Brualla , Shahram Izadi , Shuoran Yang , Cem Keskin , Sean Ryan Francesco Fanello , Philip Davidson , Jonathan Taylor , Rohit Pandey , Andrea Tagliasacchi , Pavlo Pidlypenskyi
Abstract: A method includes receiving a first image including color data and depth data, determining a viewpoint associated with an augmented reality (AR) and/or virtual reality (VR) display displaying a second image, receiving at least one calibration image including an object in the first image, the object being in a different pose as compared to a pose of the object in the first image, and generating the second image based on the first image, the viewpoint and the at least one calibration image.
-
Patent Agency Ranking
公开(公告)号：US20190236344A1
公开(公告)日：2019-08-01
申请号：US15882309
申请日：2018-01-29
Applicant: Google LLC
Inventor： Shiqi Chen , Rong Liu , Rohit Pandey , Marie White , Xue Wang , Pavlo Pidlypenskyi
CPC classification number: G06K9/00355 , G06F3/011 , G06F3/017 , G06F3/0346 , G06K9/00671 , G06K9/3233 , G06K9/6256 , G06K9/6273 , G06K9/66
Abstract: In at least one aspect, a method can include generating a respective set of training set of images for each label in a handedness model by: receiving the label at an image capturing device, obtaining a set of captured images by recording a pass-through image of a user placing a target object within an overlay of a bounding area animation, the target object corresponding with the label, and associating the label with each image in the set of captured images. The method includes training, using the training images, the handedness model to provide a correct label for an input image.
-
公开(公告)号：US20220014723A1
公开(公告)日：2022-01-13
申请号：US17309440
申请日：2019-12-02
Applicant: Google LLC
Inventor： Rohit Pandey , Jonathan Taylor , Ricardo Martin Brualla , Shuoran Yang , Pavlo Pidlypenskyi , Daniel Goldman , Sean Ryan Francesco Fanello
IPC: H04N13/111 , H04N13/161 , H04N13/366 , H04N13/243 , H04N13/332 , G06T7/174 , G06K9/32 , G06K9/00 , G06K9/46
Abstract: Three-dimensional (3D) performance capture and machine learning can be used to re-render high quality novel viewpoints of a captured scene. A textured 3D reconstruction is first rendered to a novel viewpoint. Due to imperfections in geometry and low-resolution texture, the 2D rendered image contains artifacts and is low quality. Accordingly, a deep learning technique is disclosed that takes these images as input and generates more visually enhanced re-rendering. The system is specifically designed for VR and AR headsets, and accounts for consistency between two stereo views.
-
公开(公告)号：US11288857B2
公开(公告)日：2022-03-29
申请号：US16837612
申请日：2020-04-01
Applicant: Google LLC
Inventor： Moustafa Meshry , Ricardo Martin Brualla , Sameh Khamis , Daniel Goldman , Hugues Hoppe , Noah Snavely , Rohit Pandey
Abstract: According to an aspect, a method for neural rerendering includes obtaining a three-dimensional (3D) model representing a scene of a physical space, where the 3D model is constructed from a collection of input images, rendering an image data buffer from the 3D model according to a viewpoint, where the image data buffer represents a reconstructed image from the 3D model, receiving, by a neural rerendering network, the image data buffer, receiving, by the neural rerendering network, an appearance code representing an appearance condition, and transforming, by the neural rerendering network, the image data buffer into a rerendered image with the viewpoint of the image data buffer and the appearance condition specified by the appearance code.
-
公开(公告)号：US20200349772A1
公开(公告)日：2020-11-05
申请号：US16861530
申请日：2020-04-29
Applicant: Google LLC
Inventor： Anastasia Tkach , Ricardo Martin Brualla , Shahram Izadi , Shuoran Yang , Cem Keskin , Sean Ryan Francesco Fanello , Philip Davidson , Jonathan Taylor , Rohit Pandey , Andrea Tagliasacchi , Pavlo Pidlypenskyi
Abstract: A method includes receiving a first image including color data and depth data, determining a viewpoint associated with an augmented reality (AR) and/or virtual reality (VR) display displaying a second image, receiving at least one calibration image including an object in the first image, the object being in a different pose as compared to a pose of the object in the first image, and generating the second image based on the first image, the viewpoint and the at least one calibration image.
-
公开(公告)号：US20200320777A1
公开(公告)日：2020-10-08
申请号：US16837612
申请日：2020-04-01
Applicant: Google LLC
Inventor： Moustafa Meshry , Ricardo Martin Brualla , Sameh Khamis , Daniel Goldman , Hugues Hoppe , Noah Snavely , Rohit Pandey
Abstract: According to an aspect, a method for neural rerendering includes obtaining a three-dimensional (3D) model representing a scene of a physical space, where the 3D model is constructed from a collection of input images, rendering an image data buffer from the 3D model according to a viewpoint, where the image data buffer represents a reconstructed image from the 3D model, receiving, by a neural rerendering network, the image data buffer, receiving, by the neural rerendering network, an appearance code representing an appearance condition, and transforming, by the neural rerendering network, the image data buffer into a rerendered image with the viewpoint of the image data buffer and the appearance condition specified by the appearance code.
-
-
-
-
-
-
-
Search Results
8
records
(took 0.013 seconds)
