公开(公告)号：US11763479B2

公开(公告)日：2023-09-19

申请号：US18072855

申请日：2022-12-01

Applicant: Apple Inc.

Inventor： Amit Jain ,  Aditya Sankar ,  Qi Shan ,  Alexandre Da Veiga ,  Shreyas V. Joshi

IPC: G06T7/62 ,  G06T7/60 ,  G06V20/64 ,  G06F18/241 ,  G06V10/764 ,  G06V10/80 ,  G06V10/82 ,  G06V10/70 ,  G06V10/44 ,  G06V20/00 ,  G06V10/22

CPC classification number: G06T7/62 ,  G06F18/241 ,  G06T7/60 ,  G06V10/22 ,  G06V10/454 ,  G06V10/764 ,  G06V10/803 ,  G06V10/82 ,  G06V10/87 ,  G06V20/00 ,  G06V20/64 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide measurements of objects based on a location of a surface of the objects. An exemplary process may include obtaining a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generating a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, determining a class of the object based on the 3D semantic data, determining a location of a surface of the object based on the class of the object, the location determined by identifying a plane within the 3D bounding box having semantics in the 3D semantic data satisfying surface criteria for the object, and providing a measurement of the object, the measurement of the object determined based on the location of the surface of the object.

公开(公告)号：US11574485B2

公开(公告)日：2023-02-07

申请号：US17148965

申请日：2021-01-14

Applicant: Apple Inc.

Inventor： Amit Jain ,  Aditya Sankar ,  Qi Shan ,  Alexandre Da Veiga ,  Shreyas V. Joshi

IPC: G06V20/64 ,  G06K9/62 ,  G06T7/60 ,  G06V10/22

Abstract: Various implementations disclosed herein include devices, systems, and methods that obtain a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generate a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, classify the object based on the 3D bounding box and the 3D semantic data, and display a measurement of the object, where the measurement of the object is determined using one of a plurality of class-specific neural networks selected based on the classifying of the object.

公开(公告)号：US20210224516A1

公开(公告)日：2021-07-22

申请号：US17148965

申请日：2021-01-14

Applicant: Apple Inc.

Inventor： Amit Jain ,  Aditya Sankar ,  Qi Shan ,  Alexandre Da Veiga ,  Shreyas V. Joshi

IPC: G06K9/00 ,  G06K9/62 ,  G06T7/60 ,  G06K9/20

Abstract: Various implementations disclosed herein include devices, systems, and methods that obtain a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generate a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, classify the object based on the 3D bounding box and the 3D semantic data, and display a measurement of the object, where the measurement of the object is determined using one of a plurality of class-specific neural networks selected based on the classifying of the object.

公开(公告)号：US20230094061A1

公开(公告)日：2023-03-30

申请号：US18072855

申请日：2022-12-01

Applicant: Apple Inc.

Inventor： Amit Jain ,  Aditya Sankar ,  Qi Shan ,  Alexandre Da Veiga ,  Shreyas V. Joshi

IPC: G06V20/64 ,  G06K9/62 ,  G06T7/60 ,  G06V10/22

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide measurements of objects based on a location of a surface of the objects. An exemplary process may include obtaining a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generating a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, determining a class of the object based on the 3D semantic data, determining a location of a surface of the object based on the class of the object, the location determined by identifying a plane within the 3D bounding box having semantics in the 3D semantic data satisfying surface criteria for the object, and providing a measurement of the object, the measurement of the object determined based on the location of the surface of the object.

公开(公告)号：US12254244B1

公开(公告)日：2025-03-18

申请号：US17234898

申请日：2021-04-20

Applicant: Apple Inc.

Inventor： Alexandre Da Veiga ,  Afshin Dehghan ,  Amit Jain

IPC: G06F30/13 ,  G06T7/50 ,  G06T7/70 ,  G06T19/00 ,  G06T19/20 ,  G06V20/20

Abstract: Various implementations disclosed herein include devices, systems, and methods that determines two-dimensional (2D) floorplans based on image data and refines the 2D floorplans using various user interface controls. For example, an example process may include obtaining a floorplan that is generated based on a sequence of images of a physical environment, identify a type of an object depicted in the floorplan, identify a context of the object depicted in the floorplan, and modify the floorplan based on the type and the context of the object.