公开(公告)号：US11762620B2

公开(公告)日：2023-09-19

申请号：US17534102

申请日：2021-11-23

Applicant: Apple Inc.

Inventor： Justin D. Stoyles ,  Michael Kuhn

IPC: G06F3/14 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20

CPC classification number: G06F3/1423 ,  G02B27/0093 ,  G02B27/017 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/04815 ,  G06F3/04842 ,  G06T7/74 ,  G06T19/006 ,  G06V20/20 ,  G06V40/20 ,  H04B5/0025 ,  G02B2027/0187

Abstract: In an exemplary process for accessing a function of an external device through a computer-generated reality interface, one or more external devices are detected. Image data of a physical environment captured by an image sensor is obtained. The process determines whether the image data includes a representation of a first external device of the one or more detected external devices. In accordance with determining that the image data includes a representation of the first external device, the process causing a display to concurrently display a representation of the physical environment according to the image data, and an affordance corresponding to a function of the first external device, wherein detecting user activation of the displayed affordance causes the first external device to perform an action corresponding to the function.

公开(公告)号：US11727675B2

公开(公告)日：2023-08-15

申请号：US16986737

申请日：2020-08-06

Applicant: Apple Inc.

Inventor： Aitor Aldoma Buchaca ,  Andreas N. Moeller ,  Michael Kuhn

IPC: G06K9/00 ,  G06V10/82 ,  G06N20/00 ,  G06V20/20 ,  G06V20/00 ,  G06V20/64 ,  G06V10/764

CPC classification number: G06V10/82 ,  G06N20/00 ,  G06V10/764 ,  G06V20/20 ,  G06V20/35 ,  G06V20/64

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a particular object instance in CGR environments. In some implementations, an object type of an object depicted in an image of a physical environment is identified. Then, a particular instance is determined based on the object type and the image. In some implementations, objects of the particular instance have a set of characteristics that differs from sets of characteristics associated with other instances of the object type. Then, the set of characteristics of the particular instance of the object depicted in the physical environment is obtained.

公开(公告)号：US11727648B2

公开(公告)日：2023-08-15

申请号：US17007928

申请日：2020-08-31

Applicant: Apple Inc.

Inventor： Michael E. Buerli ,  Andreas Moeller ,  Michael Kuhn

IPC: G06T19/00 ,  G06T15/08 ,  G06T7/33 ,  G06F3/01

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06T7/33 ,  G06T7/337 ,  G06T15/08 ,  G06T2207/30208

Abstract: According to various implementations, a method is performed at a first electronic device with a non-transitory memory and one or more processors. The method includes determining a reference location in a three-dimensional space based on a feature. The feature is generated by a second electronic device. The method includes obtaining, for the reference location, first reference coordinates in an augmented reality coordinate system of the first electronic device and second reference coordinates in an augmented reality coordinate system of the second electronic device. The method includes determining a coordinate transformation based on a function of the first reference coordinates and the second reference coordinates. The method includes synchronizing an augmented reality coordinate system of the first electronic device with an augmented reality coordinate system of the second electronic device using the coordinate transformation.

公开(公告)号：US20240005652A1

公开(公告)日：2024-01-04

申请号：US18214214

申请日：2023-06-26

Applicant: Apple Inc.

Inventor： Aitor Aldoma Buchaca ,  Andreas N. Moeller ,  Michael Kuhn

IPC: G06V10/82 ,  G06N20/00 ,  G06V20/20 ,  G06V20/00 ,  G06V20/64 ,  G06V10/764

CPC classification number: G06V10/82 ,  G06N20/00 ,  G06V20/20 ,  G06V20/35 ,  G06V20/64 ,  G06V10/764

Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a particular object instance in CGR environments. In some implementations, an object type of an object depicted in an image of a physical environment is identified. Then, a particular instance is determined based on the object type and the image. In some implementations, objects of the particular instance have a set of characteristics that differs from sets of characteristics associated with other instances of the object type. Then, the set of characteristics of the particular instance of the object depicted in the physical environment is obtained.

公开(公告)号：US10820795B1

公开(公告)日：2020-11-03

申请号：US16015683

申请日：2018-06-22

Applicant: Apple Inc.

Inventor： Thibaut Weise ,  Justin D. Stoyles ,  Michael Kuhn ,  Reinhard Klapfer ,  Stefan Misslinger

IPC: A61B3/11 ,  G02C13/00 ,  G02B27/01 ,  G06K9/20 ,  G02B7/02

Abstract: In one implementation, a method includes: determining an interpupillary distance (IPD) measurement for a user based on a function of depth data obtained by the depth sensor and image data obtained by the image sensor; and calibrating a head-mounted device (HMD) provided to deliver augmented reality/virtual reality (AR/VR) content by setting one or more presentation parameters of the HMD based on the IPD measurement in order to tailor one or more AR/VR displays of the HMD to a field-of-view of the user.

公开(公告)号：US10074215B2

公开(公告)日：2018-09-11

申请号：US14616213

申请日：2015-02-06

Applicant: Apple Inc.

Inventor： Peter Meier ,  Michael Kuhn ,  Frank Angermann

IPC: G06T19/00

CPC classification number: G06T19/006 ,  G06T19/00 ,  G06T2219/024

Abstract: A method for representing virtual information in a view of a real environment comprises providing a virtual object having a global position and orientation with respect to a geographic global coordinate system, with first pose data on the global position and orientation of the virtual object, in a database of a server, taking an image of a real environment by a mobile device and providing second pose data as to at which position and with which orientation with respect to the geographic global coordinate system the image was taken. The method further includes displaying the image on a display of the mobile device, accessing the virtual object in the database and positioning the virtual object in the image on the basis of the first and second pose data, manipulating the virtual object or adding a further virtual object, and providing the manipulated virtual object with modified first pose data or the further virtual object with third pose data in the database.

公开(公告)号：US11880951B2

公开(公告)日：2024-01-23

申请号：US17818255

申请日：2022-08-08

Applicant: Apple Inc.

Inventor： Peter Meier ,  Michael Kuhn ,  Frank Angermann

IPC: G06T19/00 ,  G06T7/73 ,  G01S19/01

CPC classification number: G06T19/006 ,  G06T7/74 ,  G06T19/00 ,  G01S19/01 ,  G06T2219/024

Abstract: A method for representing virtual information in a view of a real environment comprises providing a virtual object having a global position and orientation with respect to a geographic global coordinate system, with first pose data on the global position and orientation of the virtual object, in a database of a server, taking an image of a real environment by a mobile device and providing second pose data as to at which position and with which orientation with respect to the geographic global coordinate system the image was taken. The method further includes displaying the image on a display of the mobile device, accessing the virtual object in the database and positioning the virtual object in the image on the basis of the first and second pose data, manipulating the virtual object or adding a further virtual object, and providing the manipulated virtual object with modified first pose data or the further virtual object with third pose data in the database.

公开(公告)号：US20240005611A1

公开(公告)日：2024-01-04

申请号：US18213040

申请日：2023-06-22

Applicant: Apple Inc.

Inventor： Michael E. Buerli ,  Andreas Moeller ,  Michael Kuhn

IPC: G06T19/00 ,  G06T15/08 ,  G06T7/33 ,  G06F3/01

CPC classification number: G06T19/006 ,  G06T15/08 ,  G06T7/337 ,  G06F3/011 ,  G06T7/33 ,  G06T2207/30208

Abstract: According to various implementations, a method is performed at a first electronic device with a non-transitory memory and one or more processors. The method includes determining a reference location in a three-dimensional space based on a feature. The feature is generated by a second electronic device. The method includes obtaining, for the reference location, first reference coordinates in an augmented reality coordinate system of the first electronic device and second reference coordinates in an augmented reality coordinate system of the second electronic device. The method includes determining a coordinate transformation based on a function of the first reference coordinates and the second reference coordinates. The method includes synchronizing an augmented reality coordinate system of the first electronic device with an augmented reality coordinate system of the second electronic device using the coordinate transformation.

公开(公告)号：US11087558B1

公开(公告)日：2021-08-10

申请号：US17026855

申请日：2020-09-21

Applicant: Apple Inc.

Inventor： Michael Kuhn ,  Justin D. Stoyles

IPC: G06T19/00 ,  H04N21/475 ,  G06K9/00 ,  H04W4/30 ,  G02B27/01

Abstract: The present disclosure relates to managing augmented reality content created on a first electronic device and viewed at a second electronic device. In some embodiments, the first electronic device determines its physical location, receives input representing user-generated augmented reality content, displays an augmented reality environment including the user-generated augmented reality content overlaid on a live view of the physical location, and sends the user-generated augmented reality content to an external storage repository. The second electronic device can then receive the user-generated augmented reality content, determine whether it is at the physical location, and display the user-generated augmented reality content when it is at the physical location.

公开(公告)号：US10803666B1

公开(公告)日：2020-10-13

申请号：US16015661

申请日：2018-06-22

Applicant: Apple Inc.

Inventor： Michael E. Buerli ,  Andreas Moeller ,  Michael Kuhn

IPC: G06T19/00 ,  G06T15/08 ,  G06T7/33

Abstract: In one implementation, a method, performed at a first electronic device with one or more processors, a display, and one or more input devices, includes obtaining, for a reference location in a three-dimensional space, first reference coordinates in an augmented reality coordinate system of the first electronic device. The method includes obtaining, for the reference location in the three-dimensional space, second reference coordinates based on transformation data received from a second electronic device. The method includes determining a coordinate transformation based on the first reference coordinates and the second reference coordinates. The method includes synchronizing the augmented reality coordinate system of the first electronic device with an augmented reality coordinate system of the second electronic device using the coordinate transformation.