公开(公告)号：US20230186575A1

公开(公告)日：2023-06-15

申请号：US17998903

申请日：2020-05-22

Applicant: GOOGLE LLC

Inventor： Eric Turner ,  Keisuke Tateno ,  Konstantine Nicholas John Tsotsos ,  Adarsh Prakash Murthy Kowdle ,  Vaibhav Gupta ,  Ambrus Csaszar

IPC: G06T19/00 ,  G06T1/60

CPC classification number: G06T19/006 ,  G06T1/60

Abstract: A method including receiving a first depth image associated with a first frame at a first time of an augmented reality (AR) application, the first depth image representing at least a first portion of a real-world space storing the first depth image receiving a second depth image associated with a second frame at a second time, after the first time, of the AR application, the second depth image representing at least a second portion of the real-world space generating a real-world image by blending, at least, the stored first depth image with the second depth image receiving a rendered AR object combining the AR object in the real-world image and displaying the real-world image combined with the AR object.

公开(公告)号：US20230177778A1

公开(公告)日：2023-06-08

申请号：US17643233

申请日：2021-12-08

Applicant: GOOGLE LLC

Inventor： Sazzadur Rahman ,  Konstantine Nicholas John Tsotsos ,  João Manuel de Castro Afonso ,  José Carlos Maranhão Pascoal ,  Ivo Duarte ,  Nuno Cruces

IPC: G06T19/00 ,  G06T15/04

CPC classification number: G06T19/006 ,  G06T15/04

Abstract: A split-architecture for rendering and warping world-locked AR elements, such as graphics in a navigation application, for display on augmented reality (AR) glasses is disclosed. The split-architecture can help to alleviate a resource burden on the AR glasses by performing the more complex processes associated with the rendering and warping on a computing device, while performing the less complex processes associated with the rendering and warping on the AR glasses. The AR glasses and the computing device are coupled via wireless communication, and the disclosed systems and methods address the large and variable latencies associated with the wireless communication that could otherwise make splitting these processes impractical.

公开(公告)号：US11681358B1

公开(公告)日：2023-06-20

申请号：US17643711

申请日：2021-12-10

Applicant: GOOGLE LLC

Inventor： Sazzadur Rahman ,  Konstantine Nicholas John Tsotsos ,  João Manuel de Castro Afonso ,  José Carlos Maranhão Pascoal ,  Ivo Duarte ,  Nuno Cruces

IPC: G06F3/01 ,  G02B27/00 ,  G02B27/01 ,  G06T19/00

CPC classification number: G06F3/012 ,  G02B27/0093 ,  G02B27/017 ,  G02B27/0179 ,  G06T19/006 ,  G02B2027/0178 ,  G02B2027/0187

Abstract: A method includes projecting an augmented reality (AR) user interface (UI) at a first position on a surface of a head-mounted display (HMD) device through which a view of a real-world scene is seen by a viewer, and detecting a motion of the HMD device corresponding to a head motion of the viewer. The method further includes, in response to the motion of the HMD device, moving the projected AR UI across the surface of the HMD device to a second position, the movement of the projected AR UI spatially and or temporally lagging the head motion.

公开(公告)号：US20230185365A1

公开(公告)日：2023-06-15

申请号：US17643711

申请日：2021-12-10

Applicant: GOOGLE LLC

Inventor： Sazzadur Rahman ,  Konstantine Nicholas John Tsotsos ,  João Manuel de Castro Afonso ,  José Carlos Maranhão Pascoal ,  Ivo Duarte ,  Nuno Cruces

IPC: G06F3/01 ,  G02B27/00 ,  G02B27/01 ,  G06T19/00

CPC classification number: G06F3/012 ,  G02B27/0093 ,  G02B27/0179 ,  G02B27/017 ,  G06T19/006 ,  G02B2027/0178 ,  G02B2027/0187

Abstract: A method includes projecting an augmented reality (AR) user interface (UI) at a first position on a surface of a head-mounted display (HMD) device through which a view of a real-world scene is seen by a viewer, and detecting a motion of the HMD device corresponding to a head motion of the viewer. The method further includes, in response to the motion of the HMD device, moving the projected AR UI across the surface of the HMD device to a second position, the movement of the projected AR UI spatially and or temporally lagging the head motion.

公开(公告)号：US20210166437A1

公开(公告)日：2021-06-03

申请号：US15733376

申请日：2019-10-16

Applicant: Google LLC

Inventor： Chloe LeGendre ,  Laurent Charbonnel ,  Christina Tong ,  Konstantine Nicholas John Tsotsos ,  Wan-Chun Ma ,  Paul Debevec

IPC: G06T11/00 ,  G06T3/20 ,  G06T3/60 ,  G06T7/70

Abstract: Systems, methods, and computer program products are described that implement obtaining, at an electronic computing device and for at least one image of a scene rendered in an Augmented Reality (AR) environment, a scene lighting estimation captured at a first time period. The scene lighting estimation may include at least a first image measurement associated with the scene. The implementations may include determining, at the electronic computing device, a second image measurement associated with the scene at a second time period, determining a function of the first image measurement and the second image measurement. Based on the determined function, the implementations may also include triggering calculation of a partial lighting estimation update or triggering calculation of a full lighting estimation update and rendering, on a screen of the electronic computing device and for the scene, the scene using the partial lighting estimation update or the full lighting estimation update.