公开(公告)号：US12020380B2

公开(公告)日：2024-06-25

申请号：US17568624

申请日：2022-01-04

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Praveen Sharma ,  Mark K. Hauenstein

IPC: G06T19/00 ,  G06F3/04815 ,  G06F3/04817

CPC classification number: G06T19/006 ,  G06F3/04815 ,  G06F3/04817 ,  G06T2200/24

Abstract: A computer system displays a representation of a previously-captured media item, which includes or is associated with depth information corresponding to a physical environment in which the media item was captured. While displaying the representation of the media item, the system receives, via one or more input devices, one or more inputs corresponding to a request to display a representation of a measurement corresponding to a respective portion of the physical environment captured in the media item, and, in response, the system displays the representation of the measurement over at least a portion of the representation of the media item that corresponds to the respective portion of the physical environment, based on the depth information, and a label corresponding to the representation of the measurement that describes the measurement based on the depth information.

公开(公告)号：US11632600B2

公开(公告)日：2023-04-18

申请号：US17716984

申请日：2022-04-08

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Mark K. Hauenstein ,  Praveen Sharma ,  Matan Stauber ,  Julian K. Missig ,  Jeffrey T. Bernstein ,  Lukas Robert Tom Girling ,  Matthaeus Krenn

IPC: H04N5/232 ,  H04N23/63 ,  G06T11/00 ,  G06F3/048 ,  G06F3/0488

Abstract: While displaying playback of a first portion of a video in a video playback region, a device receives a request to add a first annotation to the video playback. In response to receiving the request, the device pauses playback of the video at a first position in the video and displays a still image that corresponds to the first, paused position of the video. While displaying the still image, the device receives the first annotation on a first portion of a physical environment captured in the still image. After receiving the first annotation, the device displays, in the video playback region, a second portion of the video that corresponds to a second position in the video, where the first portion of the physical environment is captured in the second portion of the video and the first annotation is displayed in the second portion of the video.

公开(公告)号：US11615595B2

公开(公告)日：2023-03-28

申请号：US17481193

申请日：2021-09-21

Applicant: Apple Inc.

Inventor： Praveen Sharma ,  Fiona P. O'Leary ,  Joseph A. Malia

IPC: G06T19/00 ,  G06T13/20 ,  G06T7/70

Abstract: A first electronic device with one or more processors, memory, one or more cameras, and a display generation component captures, with the one or more cameras, an image of a second electronic device that includes position information displayed via a display generation component of the second electronic device. The position information indicates a location of the second electronic device within an augmented reality environment that includes a physical environment in which the first electronic device and the second electronic device are located. The first electronic device, after capturing the image of the second electronic device that includes the position information, displays, via the display generation component of the first electronic device, one or more virtual objects within the augmented reality (AR) environment using the position information captured from the second electronic device.

公开(公告)号：US11227446B2

公开(公告)日：2022-01-18

申请号：US17030209

申请日：2020-09-23

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Praveen Sharma ,  Mark K. Hauenstein

IPC: G06T15/00 ,  G06T19/00 ,  G06F3/0481

Abstract: A computer system captures, via one or more cameras, information indicative of the physical environment, including respective portions of the physical environment that are in a field of view. The respective portions of the physical environment include a plurality of primary features of the physical environment and secondary features of the physical environment. After capturing the information indicative of the physical environment, the system displays a user interface, including concurrently displaying graphical representations of the plurality of primary features that are generated with a first level of fidelity to the corresponding plurality of primary features of the physical environment, and one or more graphical representations of secondary features that are generated with a second level of fidelity to the corresponding one or more secondary features of the physical environment, where the second level of fidelity is lower than the first level of fidelity.

公开(公告)号：US20200382718A1

公开(公告)日：2020-12-03

申请号：US16997860

申请日：2020-08-19

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Mark K. Hauenstein ,  Praveen Sharma ,  Matan Stauber ,  Julian K. Missig ,  Jeffrey T. Bernstein ,  Lukas Robert Tom Girling ,  Matthaeus Krenn

IPC: H04N5/232 ,  G06T11/00

Abstract: A computer system displays a first previously captured media object including one or more first images, wherein the first previously captured media object was recorded and stored with first depth data corresponding to a first physical environment captured in each of the one or more first images. In response to a first user request to add a first virtual object to the first previously captured media object, the computer system displays the first virtual object over at least a portion of a respective image in the first previously captured media object, wherein the first virtual object is displayed with at least a first position or orientation that is determined using the first depth data that corresponds to the respective image in the first previously captured media object.

公开(公告)号：US20240290051A1

公开(公告)日：2024-08-29

申请号：US18656318

申请日：2024-05-06

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Praveen Sharma ,  Mark K. Hauenstein

IPC: G06T19/00 ,  G06F3/04815 ,  G06F3/04817

CPC classification number: G06T19/006 ,  G06F3/04815 ,  G06F3/04817 ,  G06T2200/24

Abstract: A computer system with a display generation component and one or more input devices displays a representation of a physical object that has a first respective object property and a virtual object that does not spatially overlap with the physical object. The system moves the virtual object based on movement of an input. If the movement of the input corresponds to a request to move the virtual object to a physical space that is not occupied by a physical object, the system moves the virtual object by a first amount. If the movement of the first input corresponds to a request to move the virtual object to a physical space that at least partially overlaps with the first physical object, the system moves the virtual object by a second amount, less than the first amount.

公开(公告)号：US11995783B2

公开(公告)日：2024-05-28

申请号：US18126352

申请日：2023-03-24

Applicant: Apple Inc.

Inventor： Praveen Sharma ,  Fiona P. O'Leary ,  Joseph A. Malia

IPC: G06T19/00 ,  G06T7/70 ,  G06T13/20

CPC classification number: G06T19/006 ,  G06T7/70 ,  G06T13/20

Abstract: A first electronic device with one or more processors, memory, one or more cameras, and a display generation component captures, with the one or more cameras, an image of a second electronic device that includes position information displayed via a display generation component of the second electronic device. The position information indicates a location of the second electronic device within an augmented reality environment that includes a physical environment in which the first electronic device and the second electronic device are located. The first electronic device, after capturing the image of the second electronic device that includes the position information, displays, via the display generation component of the first electronic device, one or more virtual objects within the augmented reality (AR) environment using the position information captured from the second electronic device.

公开(公告)号：US11429274B2

公开(公告)日：2022-08-30

申请号：US16868449

申请日：2020-05-06

Applicant: Apple Inc.

Inventor： Julian Missig ,  Matan Stauber ,  Guillaume Ardaud ,  Jeffrey Traer Bernstein ,  Marisa Rei Lu ,  Jiabao Li ,  Praveen Sharma ,  Christopher D. Soli

IPC: G06F3/0488 ,  G06F3/04883 ,  G06F3/0354 ,  G06F3/0485 ,  G06T13/80 ,  G06V30/32

Abstract: In some embodiments, an electronic device receives handwritten inputs in text entry fields and converts the handwritten inputs into font-based text. In some embodiments, an electronic device selects and deletes text based on inputs from a stylus. In some embodiments, an electronic device inserts text into pre-existing text based on inputs from a stylus. In some embodiments, an electronic device manages the timing of converting handwritten inputs into font-based text. In some embodiments, an electronic device presents a handwritten entry menu. In some embodiments, an electronic device controls the characteristic of handwritten inputs based on selections on the handwritten entry menu. In some embodiments, an electronic device presents autocomplete suggestions. In some embodiments, an electronic device converts handwritten input to font-based text. In some embodiments, an electronic device displays options in a content entry palette.

公开(公告)号：US20220239842A1

公开(公告)日：2022-07-28

申请号：US17716984

申请日：2022-04-08

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Mark K. Hauenstein ,  Praveen Sharma ,  Matan Stauber ,  Julian K. Missig ,  Jeffrey T. Bernstein ,  Lukas Robert Tom Girling ,  Matthaeus Krenn

IPC: H04N5/232 ,  G06T11/00

Abstract: While displaying playback of a first portion of a video in a video playback region, a device receives a request to add a first annotation to the video playback. In response to receiving the request, the device pauses playback of the video at a first position in the video and displays a still image that corresponds to the first, paused position of the video. While displaying the still image, the device receives the first annotation on a first portion of a physical environment captured in the still image. After receiving the first annotation, the device displays, in the video playback region, a second portion of the video that corresponds to a second position in the video, where the first portion of the physical environment is captured in the second portion of the video and the first annotation is displayed in the second portion of the video.

公开(公告)号：US11303812B2

公开(公告)日：2022-04-12

申请号：US16997860

申请日：2020-08-19

Applicant: Apple Inc.

Inventor： Joseph A. Malia ,  Mark K. Hauenstein ,  Praveen Sharma ,  Matan Stauber ,  Julian K. Missig ,  Jeffrey T. Bernstein ,  Lukas Robert Tom Girling ,  Matthaeus Krenn

IPC: H04N5/232 ,  G06T11/00 ,  G06F3/048 ,  G06F3/0488

Abstract: A computer system displays a first previously captured media object including one or more first images, wherein the first previously captured media object was recorded and stored with first depth data corresponding to a first physical environment captured in each of the one or more first images. In response to a first user request to add a first virtual object to the first previously captured media object, the computer system displays the first virtual object over at least a portion of a respective image in the first previously captured media object, wherein the first virtual object is displayed with at least a first position or orientation that is determined using the first depth data that corresponds to the respective image in the first previously captured media object.