公开(公告)号：US20200342668A1

公开(公告)日：2020-10-29

申请号：US16395505

申请日：2019-04-26

Applicant: GOOGLE LLC

Inventor： Roza Chojnacka ,  Meltem Oktem ,  Rajan Patel ,  Uday Idnani ,  Xiyang Luo

IPC: G06T19/00 ,  G06K9/62 ,  G06T7/73 ,  G06T7/60 ,  G06K9/00

Abstract: A system and method may provide for spatial and semantic auto-completion of an augmented or mixed reality environment. The system may detect physical objects in a physical environment based on analysis of image frames captured by an image sensor of a computing device. The system may detect spaces in the physical environment that are occupied by the detected physical objects, and may detect spaces that are unoccupied in the physical environment. Based on the identification of the detected physical objects, the system may gain a semantic understanding of the physical environment, and may determine suggested objects for placement in the physical environment based on the semantic understanding. The system may place virtual representations of the suggested objects in a mixed reality scene of the physical environment for user consideration.

公开(公告)号：US11158128B2

公开(公告)日：2021-10-26

申请号：US16395505

申请日：2019-04-26

Applicant: GOOGLE LLC

Inventor： Roza Chojnacka ,  Meltem Oktem ,  Rajan Patel ,  Uday Idnani ,  Xiyang Luo

IPC: G06T19/00 ,  G06K9/62 ,  G06T7/60 ,  G06K9/00 ,  G06T7/73

Abstract: A system and method may provide for spatial and semantic auto-completion of an augmented or mixed reality environment. The system may detect physical objects in a physical environment based on analysis of image frames captured by an image sensor of a computing device. The system may detect spaces in the physical environment that are occupied by the detected physical objects, and may detect spaces that are unoccupied in the physical environment. Based on the identification of the detected physical objects, the system may gain a semantic understanding of the physical environment, and may determine suggested objects for placement in the physical environment based on the semantic understanding. The system may place virtual representations of the suggested objects in a mixed reality scene of the physical environment for user consideration.