-
公开(公告)号：US20230360182A1
公开(公告)日：2023-11-09
申请号：US18028930
申请日：2021-05-17
Applicant: Google LLC
Inventor： Sean Ryan Francesco Fanello , Yun-Ta Tsai , Rohit Kumar Pandey , Paul Debevec , Michael Milne , Chloe LeGendre , Jonathan Tilton Barron , Christoph Rhemann , Sofien Bouaziz , Navin Padman Sarma
CPC classification number: G06T5/009 , G06T7/60 , G06T7/70 , G06T15/506 , G06T2200/24 , G06T2207/20081 , G06T2207/20084 , G06T2207/20092 , G06T2207/20208 , G06T2207/30201
Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. An example method includes applying a geometry model to an input image to determine a surface orientation map indicative of a distribution of lighting on an object based on a surface geometry. The method further includes applying an environmental light estimation model to the input image to determine a direction of synthetic lighting to be applied to the input image. The method also includes applying, based on the surface orientation map and the direction of synthetic lighting, a light energy model to determine a quotient image indicative of an amount of light energy to be applied to each pixel of the input image. The method additionally includes enhancing, based on the quotient image, a portion of the input image. One or more neural networks can be trained to perform one or more of the aforementioned aspects.
-
公开(公告)号：US20230004216A1
公开(公告)日：2023-01-05
申请号：US17305219
申请日：2021-07-01
Applicant: GOOGLE LLC
Inventor： Ivana Tosic Rodgers , Sean Ryan Francesco Fanello , Sofien Bouaziz , Rohit Kumar Pandey , Eric Aboussouan , Adarsh Prakash Murthy Kowdle
Abstract: Techniques of tracking a user's gaze includes identifying a region of a display at which a gaze of a user is directed, the region including a plurality of pixels. By determining a region rather than a point, when the regions correspond to elements of a user interface, the improved technique enables a system to activate the element to which a determined region is selected. In some implementations, the system makes the determination using a classification engine including a convolutional neural network; such an engine takes as input images of the user's eye and outputs a list of probabilities that the gaze is directed to each of the regions.
-
公开(公告)号：US20220065620A1
公开(公告)日：2022-03-03
申请号：US17413847
申请日：2020-11-11
Applicant: GOOGLE LLC
Inventor： Sean Ryan Francesco Fanello , Kaiwen Guo , Peter Christopher Lincoln , Philip Lindsley Davidson , Jessica L. Busch , Xueming Yu , Geoffrey Harvey , Sergio Orts Escolano , Rohit Kumar Pandey , Jason Dourgarian , Danhang Tang , Adarsh Prakash Murthy Kowdle , Emily B. Cooper , Mingsong Dou , Graham Fyffe , Christoph Rhemann , Jonathan James Taylor , Shahram Izadi , Paul Ernest Debevec
IPC: G01B11/25 , G06T15/50 , G01B11/245 , G06T17/20
Abstract: A lighting stage includes a plurality of lights that project alternating spherical color gradient illumination patterns onto an object or human performer at a predetermined frequency. The lighting stage also includes a plurality of cameras that capture images of an object or human performer corresponding to the alternating spherical color gradient illumination patterns. The lighting stage also includes a plurality of depth sensors that capture depth maps of the object or human performer at the predetermined frequency. The lighting stage also includes (or is associated with) one or more processors that implement a machine learning algorithm to produce a three-dimensional (3D) model of the object or human performer. The 3D model includes relighting parameters used to relight the 3D model under different lighting conditions.
-
公开(公告)号：US20200349772A1
公开(公告)日：2020-11-05
申请号：US16861530
申请日：2020-04-29
Applicant: Google LLC
Inventor： Anastasia Tkach , Ricardo Martin Brualla , Shahram Izadi , Shuoran Yang , Cem Keskin , Sean Ryan Francesco Fanello , Philip Davidson , Jonathan Taylor , Rohit Pandey , Andrea Tagliasacchi , Pavlo Pidlypenskyi
Abstract: A method includes receiving a first image including color data and depth data, determining a viewpoint associated with an augmented reality (AR) and/or virtual reality (VR) display displaying a second image, receiving at least one calibration image including an object in the first image, the object being in a different pose as compared to a pose of the object in the first image, and generating the second image based on the first image, the viewpoint and the at least one calibration image.
-
-
-
Search Results
24
records
(took 0.011 seconds)
