-
公开(公告)号:US11789528B1
公开(公告)日:2023-10-17
申请号:US17461367
申请日:2021-08-30
Applicant: Apple Inc.
Inventor: Jeffrey P. Bigham , Mingzhe Li , Samuel C. White , Xiaoyi Zhang , Qi Shan , Carlos E. Guestrin
Abstract: Calibration of eye tracking is improved by collecting additional calibration pairs when user is using apps with eye tracking. A user input component is presented on a display of an electronic device, detecting a dwelling action for user input component, and in response to detecting the dwelling action, obtaining a calibration pair comprising an uncalibrated gaze point and a screen location of the user input component, wherein the uncalibrated gaze point is determined based on an eye pose during the dwelling action. A screen gaze estimation is determine based on the uncalibrated gaze point, and in response to determining that the calibration pair is a valid calibration pair, training a calibration model using the calibration pair.
-
公开(公告)号:US12272008B2
公开(公告)日:2025-04-08
申请号:US17865910
申请日:2022-07-15
Applicant: Apple Inc.
Inventor: Ian M. Richter , Qi Shan
IPC: G06T19/00
Abstract: Various implementations disclosed herein include devices, systems, and methods for synthesizing an environment based on an image. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In various implementations, a method includes determining an engagement score that characterizes a level of engagement between a user and a representation of a subject included in an image. In some implementations, the method includes, in response to the engagement score satisfying an engagement threshold, obtaining stored information regarding the subject, and synthesizing an environment based on the image and the stored information regarding the subject.
-
公开(公告)号:US20220414995A1
公开(公告)日:2022-12-29
申请号:US17865910
申请日:2022-07-15
Applicant: Apple Inc.
Inventor: Ian M. Richter , Qi Shan
IPC: G06T19/00
Abstract: Various implementations disclosed herein include devices, systems, and methods for synthesizing an environment based on an image. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In various implementations, a method includes determining an engagement score that characterizes a level of engagement between a user and a representation of a subject included in an image. In some implementations, the method includes, in response to the engagement score satisfying an engagement threshold, obtaining stored information regarding the subject, and synthesizing an environment based on the image and the stored information regarding the subject.
-
公开(公告)号:US11106280B1
公开(公告)日:2021-08-31
申请号:US17027266
申请日:2020-09-21
Applicant: Apple Inc.
Inventor: Jeffrey P. Bigham , Mingzhe Li , Samuel C. White , Xiaoyi Zhang , Qi Shan , Carlos E. Guestrin
Abstract: Calibration of eye tracking is improved by collecting additional calibration pairs when user is using apps with eye tracking. A user input component is presented on a display of an electronic device, detecting a dwelling action for user input component, and in response to detecting the dwelling action, obtaining a calibration pair comprising an uncalibrated gaze point and a screen location of the user input component, wherein the uncalibrated gaze point is determined based on an eye pose during the dwelling action. A screen gaze estimation is determine based on the uncalibrated gaze point, and in response to determining that the calibration pair is a valid calibration pair, training a calibration model using the calibration pair.
-
公开(公告)号:US12223669B2
公开(公告)日:2025-02-11
申请号:US17670686
申请日:2022-02-14
Applicant: Apple Inc.
Inventor: Aditya Sankar , Qi Shan , Shreyas V. Joshi , David Guera Cobo , Fareeha Irfan , Bryan M. Perfetti
Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a wrist measurement or watch band size using depth data captured by a depth sensor from one or more rotational orientations of the wrist. In some implementations, depth data captured by a depth sensor including at least two depth map images of a wrist from different angles is obtained. In some implementations, an output is generated based on inputting the depth data into a machine learning model, the output corresponding to circumference of the wrist or a watch band size of the wrist. Then, a watch band size recommendation is provided based on the output.
-
公开(公告)号:US11967015B2
公开(公告)日:2024-04-23
申请号:US17145232
申请日:2021-01-08
Applicant: Apple Inc.
Inventor: Qi Shan , Joshua Susskind , Aditya Sankar , Robert Alex Colburn , Emilien Dupont , Miguel Angel Bautista Martin
CPC classification number: G06T15/205 , G06N3/08 , G06T3/60
Abstract: The subject technology provides a framework for learning neural scene representations directly from images, without three-dimensional (3D) supervision, by a machine-learning model. In the disclosed systems and methods, 3D structure can be imposed by ensuring that the learned representation transforms like a real 3D scene. For example, a loss function can be provided which enforces equivariance of the scene representation with respect to 3D rotations. Because naive tensor rotations may not be used to define models that are equivariant with respect to 3D rotations, a new operation called an invertible shear rotation is disclosed, which has the desired equivariance property. In some implementations, the model can be used to generate a 3D representation, such as mesh, of an object from an image of the object.
-
公开(公告)号:US11763479B2
公开(公告)日:2023-09-19
申请号:US18072855
申请日:2022-12-01
Applicant: Apple Inc.
Inventor: Amit Jain , Aditya Sankar , Qi Shan , Alexandre Da Veiga , Shreyas V. Joshi
IPC: G06T7/62 , G06T7/60 , G06V20/64 , G06F18/241 , G06V10/764 , G06V10/80 , G06V10/82 , G06V10/70 , G06V10/44 , G06V20/00 , G06V10/22
CPC classification number: G06T7/62 , G06F18/241 , G06T7/60 , G06V10/22 , G06V10/454 , G06V10/764 , G06V10/803 , G06V10/82 , G06V10/87 , G06V20/00 , G06V20/64 , G06T2207/10028 , G06T2207/20081 , G06T2207/20084
Abstract: Various implementations disclosed herein include devices, systems, and methods that provide measurements of objects based on a location of a surface of the objects. An exemplary process may include obtaining a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generating a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, determining a class of the object based on the 3D semantic data, determining a location of a surface of the object based on the class of the object, the location determined by identifying a plane within the 3D bounding box having semantics in the 3D semantic data satisfying surface criteria for the object, and providing a measurement of the object, the measurement of the object determined based on the location of the surface of the object.
-
公开(公告)号:US11574485B2
公开(公告)日:2023-02-07
申请号:US17148965
申请日:2021-01-14
Applicant: Apple Inc.
Inventor: Amit Jain , Aditya Sankar , Qi Shan , Alexandre Da Veiga , Shreyas V. Joshi
Abstract: Various implementations disclosed herein include devices, systems, and methods that obtain a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generate a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, classify the object based on the 3D bounding box and the 3D semantic data, and display a measurement of the object, where the measurement of the object is determined using one of a plurality of class-specific neural networks selected based on the classifying of the object.
-
公开(公告)号:US20220262025A1
公开(公告)日:2022-08-18
申请号:US17670686
申请日:2022-02-14
Applicant: Apple Inc.
Inventor: Aditya Sankar , Qi Shan , Shreyas V. Joshi , David Guera Cobo , Fareeha lrfan , Bryan M. Perfetti
Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a wrist measurement or watch band size using depth data captured by a depth sensor from one or more rotational orientations of the wrist. In some implementations, depth data captured by a depth sensor including at least two depth map images of a wrist from different angles is obtained. In some implementations, an output is generated based on inputting the depth data into a machine learning model, the output corresponding to circumference of the wrist or a watch band size of the wrist. Then, a watch band size recommendation is provided based on the output.
-
公开(公告)号:US11417067B1
公开(公告)日:2022-08-16
申请号:US17242809
申请日:2021-04-28
Applicant: Apple Inc.
Inventor: Ian M. Richter , Qi Shan
IPC: G06T19/00
Abstract: Various implementations disclosed herein include devices, systems, and methods for synthesizing an environment based on an image. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In various implementations, a method includes determining an engagement score that characterizes a level of engagement between a user and a representation of a subject included in an image. In some implementations, the method includes, in response to the engagement score satisfying an engagement threshold, obtaining stored information regarding the subject, and synthesizing an environment based on the image and the stored information regarding the subject.
-
-
-
-
-
-
-
-
-