公开(公告)号：US20230094061A1

公开(公告)日：2023-03-30

申请号：US18072855

申请日：2022-12-01

Applicant: Apple Inc.

Inventor： Amit Jain ,  Aditya Sankar ,  Qi Shan ,  Alexandre Da Veiga ,  Shreyas V. Joshi

IPC: G06V20/64 ,  G06K9/62 ,  G06T7/60 ,  G06V10/22

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide measurements of objects based on a location of a surface of the objects. An exemplary process may include obtaining a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generating a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, determining a class of the object based on the 3D semantic data, determining a location of a surface of the object based on the class of the object, the location determined by identifying a plane within the 3D bounding box having semantics in the 3D semantic data satisfying surface criteria for the object, and providing a measurement of the object, the measurement of the object determined based on the location of the surface of the object.

公开(公告)号：US12223669B2

公开(公告)日：2025-02-11

申请号：US17670686

申请日：2022-02-14

Applicant: Apple Inc.

Inventor： Aditya Sankar ,  Qi Shan ,  Shreyas V. Joshi ,  David Guera Cobo ,  Fareeha Irfan ,  Bryan M. Perfetti

IPC: G06T7/55 ,  G01B11/08 ,  G06N3/04 ,  G06N20/00

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a wrist measurement or watch band size using depth data captured by a depth sensor from one or more rotational orientations of the wrist. In some implementations, depth data captured by a depth sensor including at least two depth map images of a wrist from different angles is obtained. In some implementations, an output is generated based on inputting the depth data into a machine learning model, the output corresponding to circumference of the wrist or a watch band size of the wrist. Then, a watch band size recommendation is provided based on the output.

公开(公告)号：US11967015B2

公开(公告)日：2024-04-23

申请号：US17145232

申请日：2021-01-08

Applicant: Apple Inc.

Inventor： Qi Shan ,  Joshua Susskind ,  Aditya Sankar ,  Robert Alex Colburn ,  Emilien Dupont ,  Miguel Angel Bautista Martin

IPC: G06T15/20 ,  G06N3/08 ,  G06T3/60

CPC classification number: G06T15/205 ,  G06N3/08 ,  G06T3/60

Abstract: The subject technology provides a framework for learning neural scene representations directly from images, without three-dimensional (3D) supervision, by a machine-learning model. In the disclosed systems and methods, 3D structure can be imposed by ensuring that the learned representation transforms like a real 3D scene. For example, a loss function can be provided which enforces equivariance of the scene representation with respect to 3D rotations. Because naive tensor rotations may not be used to define models that are equivariant with respect to 3D rotations, a new operation called an invertible shear rotation is disclosed, which has the desired equivariance property. In some implementations, the model can be used to generate a 3D representation, such as mesh, of an object from an image of the object.

公开(公告)号：US11763479B2

公开(公告)日：2023-09-19

申请号：US18072855

申请日：2022-12-01

Applicant: Apple Inc.

Inventor： Amit Jain ,  Aditya Sankar ,  Qi Shan ,  Alexandre Da Veiga ,  Shreyas V. Joshi

IPC: G06T7/62 ,  G06T7/60 ,  G06V20/64 ,  G06F18/241 ,  G06V10/764 ,  G06V10/80 ,  G06V10/82 ,  G06V10/70 ,  G06V10/44 ,  G06V20/00 ,  G06V10/22

CPC classification number: G06T7/62 ,  G06F18/241 ,  G06T7/60 ,  G06V10/22 ,  G06V10/454 ,  G06V10/764 ,  G06V10/803 ,  G06V10/82 ,  G06V10/87 ,  G06V20/00 ,  G06V20/64 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Various implementations disclosed herein include devices, systems, and methods that provide measurements of objects based on a location of a surface of the objects. An exemplary process may include obtaining a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generating a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, determining a class of the object based on the 3D semantic data, determining a location of a surface of the object based on the class of the object, the location determined by identifying a plane within the 3D bounding box having semantics in the 3D semantic data satisfying surface criteria for the object, and providing a measurement of the object, the measurement of the object determined based on the location of the surface of the object.

公开(公告)号：US11574485B2

公开(公告)日：2023-02-07

申请号：US17148965

申请日：2021-01-14

Applicant: Apple Inc.

Inventor： Amit Jain ,  Aditya Sankar ,  Qi Shan ,  Alexandre Da Veiga ,  Shreyas V. Joshi

IPC: G06V20/64 ,  G06K9/62 ,  G06T7/60 ,  G06V10/22

Abstract: Various implementations disclosed herein include devices, systems, and methods that obtain a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generate a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, classify the object based on the 3D bounding box and the 3D semantic data, and display a measurement of the object, where the measurement of the object is determined using one of a plurality of class-specific neural networks selected based on the classifying of the object.

公开(公告)号：US20220262025A1

公开(公告)日：2022-08-18

申请号：US17670686

申请日：2022-02-14

Applicant: Apple Inc.

Inventor： Aditya Sankar ,  Qi Shan ,  Shreyas V. Joshi ,  David Guera Cobo ,  Fareeha lrfan ,  Bryan M. Perfetti

IPC: G06T7/55 ,  G06N20/00 ,  G06N3/04 ,  G01B11/08

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a wrist measurement or watch band size using depth data captured by a depth sensor from one or more rotational orientations of the wrist. In some implementations, depth data captured by a depth sensor including at least two depth map images of a wrist from different angles is obtained. In some implementations, an output is generated based on inputting the depth data into a machine learning model, the output corresponding to circumference of the wrist or a watch band size of the wrist. Then, a watch band size recommendation is provided based on the output.

公开(公告)号：US20210224516A1

公开(公告)日：2021-07-22

申请号：US17148965

申请日：2021-01-14

Applicant: Apple Inc.

Inventor： Amit Jain ,  Aditya Sankar ,  Qi Shan ,  Alexandre Da Veiga ,  Shreyas V. Joshi

IPC: G06K9/00 ,  G06K9/62 ,  G06T7/60 ,  G06K9/20

Abstract: Various implementations disclosed herein include devices, systems, and methods that obtain a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generate a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, classify the object based on the 3D bounding box and the 3D semantic data, and display a measurement of the object, where the measurement of the object is determined using one of a plurality of class-specific neural networks selected based on the classifying of the object.