公开(公告)号：US11099707B2

公开(公告)日：2021-08-24

申请号：US16145035

申请日：2018-09-27

Applicant: Apple Inc.

Inventor： Philipp Rockel ,  Jonathan R. Dascola ,  Stephen O. Lemay ,  Jeffrey M. Faulkner ,  David J. Addey ,  David Lui ,  Giancarlo Yerkes

IPC: G06F3/0481 ,  G06T19/20 ,  G06F3/0484 ,  G06F3/0488 ,  G06T19/00 ,  G06T13/20 ,  H04M1/72403 ,  G06T7/80 ,  G06T7/70 ,  G06F3/0482 ,  G06F3/0486 ,  G06F3/048

Abstract: A computer system with a display, a touch-sensitive surface, and one or more cameras displays a virtual object in a first user interface region. In response to detecting a first input at a location that corresponds to the virtual object and in accordance with a determination that the first input meets first criteria, the virtual object is displayed in a second user interface region. In response to detecting a second input, in accordance with a determination that the second input corresponds to a request to manipulate the virtual object in the second user interface region, a display property of the virtual object is changed, and in accordance with a determination that the second input corresponds to a request to display the virtual object in an augmented reality environment, the virtual object is displayed with a representation of a field of view of the one or more cameras.

公开(公告)号：US11017608B2

公开(公告)日：2021-05-25

申请号：US16929027

申请日：2020-07-14

Applicant: Apple Inc.

Inventor： Grant R. Paul ,  Nicolas V. Scapel ,  David Lui ,  Xiao Jin Yu ,  Giancarlo Yerkes ,  Kyle E. Fisher

IPC: G06T19/00 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/01 ,  G06F3/0488 ,  G06F3/16

Abstract: An electronic device, while displaying a first user interface region and a first media item, detects a first input corresponding to a sharing user interface. In response, the device displays the sharing user interface, which includes a second user interface object for initiating a process for displaying a second representation of a first media item in an augmented reality environment. In response to detecting a sequence of one or more inputs including selection of the second user interface object, the device displays the second representation of the first media item in a second user interface that includes content of at least a portion of a field of view of the device's one or more cameras.

公开(公告)号：US20190228589A1

公开(公告)日：2019-07-25

申请号：US16145052

申请日：2018-09-27

Applicant: Apple Inc.

Inventor： Jonathan R. Dascola ,  Stephen O. Lemay ,  David J. Addey ,  David Lui ,  Giancarlo Yerkes ,  Lisa K. Forssell

IPC: G06T19/20 ,  G06T19/00 ,  G06F3/0481 ,  G06F3/0484

Abstract: A computer system having a display generation component and one or more input devices displays a representation of a virtual three-dimensional object in a user interface region. In response to an input for rotating the object, when the input corresponds to a request to rotate the object about a first axis, the object is rotated by an amount that is determined based on a magnitude of the input and is constrained by a limit on the movement restricting rotation by more than a threshold amount. When the input corresponds to a request to rotate the object about a second axis, the object is rotated relative to the second axis by an amount that is determined based on a magnitude of the input, wherein, for an input with a magnitude above a respective threshold, the device rotates the object by more than the threshold amount of rotation.

公开(公告)号：US12079945B2

公开(公告)日：2024-09-03

申请号：US18335364

申请日：2023-06-15

Applicant: Apple Inc.

Inventor： David Lui ,  Hon-Ming Chen ,  Shuai Song ,  Xiao Jin Yu

IPC: G06T19/00 ,  G06T15/00

CPC classification number: G06T19/006 ,  G06T15/005

Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.

公开(公告)号：US20230065077A1

公开(公告)日：2023-03-02

申请号：US17850077

申请日：2022-06-27

Applicant: Apple Inc.

Inventor： David Lui ,  Xiao Jin Yu ,  Tyler L. Casella ,  Hon-ming Chen ,  Shuai Song

IPC: G06T15/08 ,  G06T19/00

Abstract: A method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes rendering a first volumetric object in order to generate first object data. The method includes displaying, on the display, the first object data according to a first display mode. The first display mode includes displaying the first object data within a two-dimensional (2D) content region. The method includes detecting a request to change from the first display mode to a second display mode. The method includes, in response to detecting the request, displaying, on the display, the first object data according to the second display mode. The second display mode includes displaying the first object data within a representation of a physical environment.

公开(公告)号：US11354869B2

公开(公告)日：2022-06-07

申请号：US17204396

申请日：2021-03-17

Applicant: Apple Inc.

Inventor： David Lui ,  Hon-ming Chen ,  Shuai Song ,  Xiao Jin Yu

IPC: G06T19/00 ,  G06T15/00

Abstract: Presenting a virtual object includes obtaining, by a first device, a first geometric representation and a second geometric representation corresponding to a physical surface in a real environment, determining an initialization location on the first physical surface for a virtual object, obtaining a first normal for the first representation and a second normal for the second representation at the initialization location, and rendering the virtual object at the initialization location based on the first normal and the second normal.

公开(公告)号：US11138798B2

公开(公告)日：2021-10-05

申请号：US16581679

申请日：2019-09-24

Applicant: Apple Inc.

Inventor： Grant R. Paul ,  David Lui ,  Mathew A. Mason

IPC: G06F3/048 ,  G06T19/00 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/01 ,  G06F3/0488 ,  G06F3/16

Abstract: An electronic device displays an environment that includes a virtual object that is associated with a first action that is triggered based on satisfaction of a first set of criteria. In response to a first input detected while the environment is displayed: the first action is performed in accordance with a determination that the first input satisfies the first set of criteria, and, in accordance with a determination that the first input does not satisfy the first set of criteria but instead satisfies a second set of criteria, the first action is not performed and instead a first visual indication of one or more inputs that if performed would cause the first set of criteria to be satisfied is displayed.

公开(公告)号：US20240386641A1

公开(公告)日：2024-11-21

申请号：US18779181

申请日：2024-07-22

Applicant: Apple Inc.

Inventor： Tyler Casella ,  David Lui ,  Norman Nuo Wang ,  Xiao Jin Yu

IPC: G06T11/60

Abstract: According to various embodiments, a method of presenting a computer-generated reality (CGR) file includes receiving user inputs to present a CGR scene including one or more CGR objects. The CGR scene is associated with an anchor. The anchor is selected via a user input directed to an anchor selection affordance of a user interface. The method further includes capturing an image of a physical environment, and determining that a portion of the image corresponds to the anchor. Based on determining that the portion of the image corresponds to the anchor, the method includes displaying the CGR scene at a location of the display corresponding to the portion of the image corresponding to the anchor.

公开(公告)号：US12079910B2

公开(公告)日：2024-09-03

申请号：US17569438

申请日：2022-01-05

Applicant: Apple Inc.

Inventor： Tyler Casella ,  David Lui ,  Norman Nuo Wang ,  Xiao Jin Yu

IPC: G06T11/60

CPC classification number: G06T11/60 ,  G06T2200/24

Abstract: According to various embodiments, a method of presenting a computer-generated reality (CGR) file includes receiving user inputs to present a CGR scene including one or more CGR objects. The CGR scene is associated with an anchor. The anchor is selected via a user input directed to an anchor selection affordance of a user interface. The method further includes capturing an image of a physical environment, and determining that a portion of the image corresponds to the anchor. Based on determining that the portion of the image corresponds to the anchor, the method includes displaying the CGR scene at a location of the display corresponding to the portion of the image corresponding to the anchor.

公开(公告)号：US20220058882A1

公开(公告)日：2022-02-24

申请号：US17492425

申请日：2021-10-01

Applicant: Apple Inc.

Inventor： Grant R. Paul ,  Giancarlo Yerkes ,  Nicolas V. Scapel ,  David Lui

IPC: G06T19/00 ,  G06F3/0484 ,  G06F3/0481 ,  G06F3/01 ,  G06F3/16 ,  G06F3/0488

Abstract: An electronic device displays a first user interface with a first representation of content and, in response to receiving a request to display a virtual model that corresponds to the content, displays the virtual model of the content concurrently with a selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is configured to perform an operation associated with the content and displaying the virtual model of the content without displaying the selectable user interface object for performing the operation associated with the content in accordance with a determination that the first user interface is not configured to perform the operation associated with the content.