公开(公告)号：US20190385371A1

公开(公告)日：2019-12-19

申请号：US16012072

申请日：2018-06-19

Applicant: GOOGLE LLC

Inventor： Alan Joyce ,  Douglas Muir ,  Mark Dochtermann ,  Bryan Woods ,  Tarik Abdel-Gawad

IPC: G06T19/00 ,  G06F3/0481 ,  G06T7/70 ,  G06F3/0484 ,  G06T7/20 ,  G02B27/01

Abstract: In a system and method providing for interaction with virtual objects, and interaction between virtual objects, in an augmented reality, or mixed reality, or virtual reality, environment, detected conditions may trigger animated responses from virtual objects placed in a view of a physical environment. The detected conditions may include the detection of a user within a set threshold distance or proximity, the detection of another virtual object within a set threshold placement distance or proximity, the detection of particular environmental conditions in the view of the physical environment, and other such factors. Specific behavioral animations of the virtual objects may be triggered in response to detection of specific virtual objects and/or other conditions.

公开(公告)号：US11436808B2

公开(公告)日：2022-09-06

申请号：US17283774

申请日：2019-10-09

Applicant: GOOGLE LLC

Inventor： Diane Wang ,  Paulo Coelho ,  Tarik Hany Abdel-Gawad ,  Matthew Gilgenbach ,  Jackson Lango ,  Douglas Muir ,  Mark Dochtermann ,  Suddhasattwa Bose ,  Ashley Pinnick ,  Drew Skillman ,  Samantha Raja ,  Steven Toh ,  Brian Collins ,  Jay Steele

IPC: G06T19/00 ,  G06F3/0481 ,  G06T7/11 ,  G06F3/04815

Abstract: Disclosed are various embodiments for selecting augmenting reality (AR) objects based on contextual cues associated with an image captured by a camera associated with electronic device. Contextual cues are obtained at an electronic device and AR objects are identified from a memory associated with the electronic device. The electronic device implements a processor employing image segmentation techniques to combine the identified AR objects with the captured image and render the combined image for display at a display associated with the electronic device.

公开(公告)号：US11164367B2

公开(公告)日：2021-11-02

申请号：US16514387

申请日：2019-07-17

Applicant: Google LLC

Inventor： Ivan Neulander ,  Mark Dochtermann

IPC: G06T15/50 ,  G06T13/20 ,  G06T19/00 ,  G06T19/20

Abstract: Systems and methods for generating illumination effects for inserted luminous content, which may include augmented reality content that appears to emit light and is inserted into an image of a physical space. The content may include a polygonal mesh, which may be defined in part by a skeleton that has multiple joints. Examples may include generating a bounding box on a surface plane for the inserted content, determining an illumination center point location on the surface plane based on the content, generating an illumination entity based on the bounding box and the illumination center point location, and rendering the illumination entity using illumination values determined based on the illumination center point location. Examples may also include determining illumination contributions values for some of the joints, combining the illumination contribution values to generate illumination values for pixels, and rendering another illumination entity using the illumination values.

公开(公告)号：US11922636B2

公开(公告)日：2024-03-05

申请号：US17283688

申请日：2019-10-09

Applicant: GOOGLE LLC

Inventor： David Bond ,  Mark Dochtermann

IPC: G06T7/20 ,  G01P15/00 ,  G06T7/194 ,  G06T7/70 ,  G06T11/00 ,  G06T19/00 ,  G06V40/16

CPC classification number: G06T7/20 ,  G01P15/00 ,  G06T7/194 ,  G06T7/70 ,  G06T11/00 ,  G06T19/006 ,  G06V40/16

Abstract: An electronic device places an augmented reality object in an image of a real environment based on a pose of the electronic device and based on image segmentation. The electronic device includes a camera that captures images of the real environment and sensors, such as an inertial measurement unit (IMU), that capture a pose of the electronic device. The electronic device selects an augmented reality (AR) object from a memory, segments a captured image of the real environment into foreground pixels and background pixels, and composites an image for display wherein the AR object is placed between the foreground pixels and the background pixels. As the pose of the electronic device changes, the electronic device maintains the relative position of the AR object with respect to the real environment in images for display.

公开(公告)号：US20200342681A1

公开(公告)日：2020-10-29

申请号：US16946791

申请日：2020-07-07

Applicant: GOOGLE LLC

Inventor： Alan Joyce ,  Douglas Muir ,  Mark Dochtermann ,  Bryan Woods ,  Tarik Abdel-Gawad

IPC: G06T19/00 ,  G06T7/70 ,  G02B27/01 ,  G06F3/0481 ,  G06F3/0484 ,  G06T7/20

Abstract: In a system and method providing for interaction with virtual objects, and interaction between virtual objects, in an augmented reality, or mixed reality, or virtual reality, environment, detected conditions may trigger animated responses from virtual objects placed in a view of a physical environment. The detected conditions may include the detection of a user within a set threshold distance or proximity, the detection of another virtual object within a set threshold placement distance or proximity, the detection of particular environmental conditions in the view of the physical environment, and other such factors. Specific behavioral animations of the virtual objects may be triggered in response to detection of specific virtual objects and/or other conditions.

公开(公告)号：US20210019935A1

公开(公告)日：2021-01-21

申请号：US16514387

申请日：2019-07-17

Applicant: Google LLC

Inventor： Ivan Neulander ,  Mark Dochtermann

IPC: G06T15/50 ,  G06T13/20 ,  G06T19/20 ,  G06T19/00

Abstract: Systems and methods for generating illumination effects for inserted luminous content, which may include augmented reality content that appears to emit light and is inserted into an image of a physical space. The content may include a polygonal mesh, which may be defined in part by a skeleton that has multiple joints. Examples may include generating a bounding box on a surface plane for the inserted content, determining an illumination center point location on the surface plane based on the content, generating an illumination entity based on the bounding box and the illumination center point location, and rendering the illumination entity using illumination values determined based on the illumination center point location. Examples may also include determining illumination contributions values for some of the joints, combining the illumination contribution values to generate illumination values for pixels, and rendering another illumination entity using the illumination values.

公开(公告)号：US10748342B2

公开(公告)日：2020-08-18

申请号：US16012072

申请日：2018-06-19

Applicant: GOOGLE LLC

Inventor： Alan Joyce ,  Douglas Muir ,  Mark Dochtermann ,  Bryan Woods ,  Tarik Abdel-Gawad

IPC: G06T19/00 ,  G06T7/70 ,  G02B27/01 ,  G06F3/0481 ,  G06F3/0484 ,  G06T7/20

Abstract: In a system and method providing for interaction with virtual objects, and interaction between virtual objects, in an augmented reality, or mixed reality, or virtual reality, environment, detected conditions may trigger animated responses from virtual objects placed in a view of a physical environment. The detected conditions may include the detection of a user within a set threshold distance or proximity, the detection of another virtual object within a set threshold placement distance or proximity, the detection of particular environmental conditions in the view of the physical environment, and other such factors. Specific behavioral animations of the virtual objects may be triggered in response to detection of specific virtual objects and/or other conditions.