公开(公告)号：US11385761B2

公开(公告)日：2022-07-12

申请号：US16892045

申请日：2020-06-03

Applicant: Apple Inc.

Inventor： Cameron J. Dunn ,  Eric Steven Peyton ,  Olivier Marie Jacques Pinon ,  Etienne H. Guerard ,  David John Addey ,  Pau Sastre Miguel ,  Michelle Chua ,  Eric Thivierge

IPC: G06T15/10 ,  G06F3/0481 ,  G06F3/04815

Abstract: In one embodiment, a method of generating a computer-generated reality (CGR) file includes receiving, via one or more input devices, user input generating a computer-generated reality (CGR) scene, a user input associating an anchor with the CGR scene, user input associating one or more CGR objects with the CGR scene, wherein the CGR objects are to be displayed in association with the anchor, and user input associating a behavior with the CGR scene, wherein the behavior includes one or more triggers and actions and wherein the actions are performed in response to detecting any of the triggers. The method includes generating a CGR file including data regarding the CGR scene, the CGR file including data regarding the anchor, the CGR objects, and the behavior.

公开(公告)号：US20230350536A1

公开(公告)日：2023-11-02

申请号：US18113020

申请日：2023-02-22

Applicant: Apple Inc.

Inventor： Dan Feng ,  Aashi Manglik ,  Adam M. O'Hern ,  Bo Morgan ,  Bradley W. Peebler ,  Daniel L. Kovacs ,  Edward Ahn ,  James Moll ,  Mark E. Drummond ,  Michelle Chua ,  Mu Qiao ,  Noah Gamboa ,  Payal Jotwani ,  Siva Chandra Mouli Sivapurapu

IPC: G06F3/04815 ,  G06T17/00 ,  G10L15/22 ,  G06F3/01

CPC classification number: G06F3/04815 ,  G06T17/00 ,  G10L15/22 ,  G06F3/017 ,  G10L2015/223

Abstract: Various implementations disclosed herein include devices, systems, and methods for selecting a point-of-view (POV) for displaying an environment. In some implementations, a device includes a display, one or more processors, and a non-transitory memory. In some implementations, a method includes obtaining a request to display a graphical environment. The graphical environment is associated with a set of saliency values corresponding to respective portions of the graphical environment. A POV for displaying the graphical environment is selected based on the set of saliency values. The graphical environment is displayed from the selected POV on the display.

公开(公告)号：US20220291806A1

公开(公告)日：2022-09-15

申请号：US17825763

申请日：2022-05-26

Applicant: Apple Inc.

Inventor： Cameron J. Dunn ,  Eric Steven Peyton ,  Olivier Marie Jacques Pinon ,  Etienne H. Guerard ,  David John Addey ,  Pau Sastre Miguel ,  Michelle Chua ,  Eric Thivierge

IPC: G06F3/04815 ,  G06T15/10

Abstract: A method includes determining to present a computer-generated reality (CGR) object that is associated with a first anchor and a second anchor. The method includes determining, based on an image of a physical environment, whether the physical environment includes a portion corresponding to the first anchor. The method includes, in response to determining that the physical environment lacks a portion that corresponds to the first anchor, determining, based on the image, whether the physical environment includes a portion corresponding to the second anchor. The method includes, in response to determining that the physical environment includes a portion that corresponds to the second anchor, displaying, on the display, the CGR object at a location of the display corresponding to the second anchor.

公开(公告)号：US11182044B2

公开(公告)日：2021-11-23

申请号：US16887426

申请日：2020-05-29

Applicant: Apple Inc.

Inventor： Gerald Louis Guyomard ,  Etienne H. Guerard ,  Adam Michael O'Hern ,  Michelle Chua ,  Robin-Yann Joram Storm ,  Adam James Bolton ,  Zachary Becker ,  Bradley Warren Peebler

IPC: G06F3/0481 ,  G06F3/0484 ,  G06F3/0488

Abstract: A method includes displaying a spatial manipulation user interface element including a first set of spatial manipulation affordances respectively associated with a first set of spatial manipulations of a three-dimensional object. The first set of spatial manipulations is based on a first virtual camera perspective. The method includes, in response to detecting a user input changing the first virtual camera perspective to a second virtual camera perspective, changing display of the three-dimensional object from the first virtual camera perspective to the second virtual camera perspective, and displaying a second set of spatial manipulation affordances respectively associated with a second set of spatial manipulations. The second set of spatial manipulations is based on the second virtual camera perspective, and includes a spatial manipulation excluded from the first set of spatial manipulations. The first set of spatial manipulations includes a spatial manipulation excluded from the second set of spatial manipulations.

公开(公告)号：US12141423B2

公开(公告)日：2024-11-12

申请号：US17807226

申请日：2022-06-16

Applicant: Apple Inc.

Inventor： Zachary Z. Becker ,  Michelle Chua ,  David A. Lipton ,  Robin Yann Joram Storm ,  Eric G. Thivierge ,  Jue Wang

IPC: G06F3/04845 ,  G06F3/04815 ,  G06F3/04842

Abstract: A computer-generated virtual object manipulator having one or more affordances for manipulating a computer-generated virtual object is disclosed. Selection of a virtual object can cause an object manipulator to be displayed over the virtual object. The object manipulator can include a cone-shaped single-axis translation affordance for each of one or more object axes, a disc-shaped single-axis scale affordance for each of the one or more object axes, an arc-shaped rotation affordance for rotation about each of the one or more object axes, and a center of object affordance for free space movement of the virtual object. The object manipulator can also include a slice-shaped two-axis translation affordance that can be displayed after hovering over an area in a particular plane.

公开(公告)号：US20220350461A1

公开(公告)日：2022-11-03

申请号：US17868478

申请日：2022-07-19

Applicant: Apple Inc.

Inventor： Gerald Louis Guyomard ,  Etienne H. Guerard ,  Adam Michael O'Hern ,  Michelle Chua ,  Robin-Yann Joram Storm ,  Adam James Bolton ,  Zachary Becker ,  Bradley Warren Peebler

IPC: G06F3/04815 ,  G06F3/04842 ,  G06F3/04845 ,  G06F3/0488 ,  G06F3/0484 ,  G06F3/0481

Abstract: Various implementations disclosed herein include a method performed by a device. While executing a CGR application, the method includes displaying a three-dimensional object in a three-dimensional space, wherein the three-dimensional space is defined by a three-dimensional coordinate system. The method also includes: detecting a first user input directed to the three-dimensional object; and in response to detecting the first user input, displaying a spatial manipulation user interface element including a set of spatial manipulation affordances respectively associated with a set of spatial manipulations of the three-dimensional object, wherein each of the set of spatial manipulations corresponds to a translational movement of the three-dimensional object along a corresponding axis of the three-dimensional space.

公开(公告)号：US12100229B2

公开(公告)日：2024-09-24

申请号：US17406134

申请日：2021-08-19

Applicant: APPLE INC.

Inventor： Etienne Guerard ,  Omar Shaik ,  Michelle Chua ,  Zachary Z. Becker

IPC: G06V20/64 ,  G06T17/00 ,  G06V20/10 ,  H04N23/60 ,  H04N23/63

CPC classification number: G06V20/64 ,  G06T17/00 ,  G06V20/10 ,  G06V20/647 ,  H04N23/635 ,  H04N23/64 ,  G06T2200/08

Abstract: Various implementations disclosed herein include devices, systems, and methods that facilitate the creation of a 3D model for object detection based on a scan of the object. Some implementations provide a user interface that a user interacts with to facilitate a scan of an object to create 3D model of the object for later object detection. The user interface may include an indicator that provides visual or audible feedback to the user indicating the direction that the capturing device is facing relative to the object being scanned. The direction of the capture device may be identified using sensors on the device (e.g., inertial measurement unit (IMU), gyroscope, etc.) or other techniques (e.g., visual inertial odometry (VIO)) and based on the user positioning the device so that the object is in view.

公开(公告)号：US20220019335A1

公开(公告)日：2022-01-20

申请号：US17492304

申请日：2021-10-01

Applicant: Apple Inc.

Inventor： Gerald Louis Guyomard ,  Etienne H. Guerard ,  Adam Michael O'Hern ,  Michelle Chua ,  Robin-Yann Joram Storm ,  Adam James Bolton ,  Zachary Becker ,  Bradley Warren Peebler

IPC: G06F3/0481 ,  G06F3/0484 ,  G06F3/0488

Abstract: Various implementations disclosed herein include a method performed by a device. The method includes displaying a three-dimensional object in a three-dimensional space. The method includes displaying a spatial manipulation user interface element including a set of spatial manipulation affordances respectively associated with a set of spatial manipulations of the three-dimensional object. Each of the set of spatial manipulations corresponds to a translational movement of the three-dimensional object along a corresponding axis of the three-dimensional space. The method includes detecting a first user input directed to a first spatial manipulation affordance of the spatial manipulation affordance. The first spatial manipulation affordance is associated with a first axis of the three-dimensional space. The method includes, in response to detecting the first user input directed to the first spatial manipulation affordance, translationally moving the three-dimensional object along the first axis of the three-dimensional space.

公开(公告)号：US20200379626A1

公开(公告)日：2020-12-03

申请号：US16887426

申请日：2020-05-29

Applicant: Apple Inc.

Inventor： Gerald Louis Guyomard ,  Etienne H. Guerard ,  Adam Michael O'Hern ,  Michelle Chua ,  Robin-Yann Joram Storm ,  Adam James Bolton ,  Zachary Becker ,  Bradley Warren Peebler

IPC: G06F3/0481 ,  G06F3/0484 ,  G06F3/0488

Abstract: In one implementation, a method of spatially manipulating a three-dimension object includes displaying a three-dimensional object in a three-dimensional space from a first virtual camera perspective, wherein the three-dimensional space is defined by a three-dimensional coordinate system including three perpendicular axes. The method includes displaying a spatial manipulation user interface element including a first set of spatial manipulation affordances respectively associated with a first set of spatial manipulations of the three-dimensional object, wherein the first set of spatial manipulations is based on the first virtual camera perspective. The method includes detecting a user input changing the first virtual camera perspective to a second virtual camera perspective. The method includes, in response to detecting the user input changing the first virtual camera perspective to a second virtual camera perspective, displaying the three-dimensional object in the three-dimensional space from the second virtual camera perspective and displaying the spatial manipulation user interface element including a second set of spatial manipulation affordances respectively associated with a second set of spatial manipulations of the three-dimensional object, wherein the second set of spatial manipulations is based on the second virtual camera perspective, wherein the first set of spatial manipulations includes at least one spatial manipulation excluded from the second set of spatial manipulations and the second set of spatial manipulations includes at least one spatial manipulation excluded from the first set of spatial manipulations.

公开(公告)号：US11782571B2

公开(公告)日：2023-10-10

申请号：US17868478

申请日：2022-07-19

Applicant: Apple Inc.

Inventor： Gerald Louis Guyomard ,  Etienne H. Guerard ,  Adam Michael O'Hern ,  Michelle Chua ,  Robin-Yann Joram Storm ,  Adam James Bolton ,  Zachary Becker ,  Bradley Warren Peebler

IPC: G06F3/0481 ,  G06F3/0484 ,  G06F3/0488 ,  G06F3/04815 ,  G06F3/04842 ,  G06F3/04845

CPC classification number: G06F3/04815 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/0488 ,  G06F3/04842 ,  G06F3/04845

Abstract: Various implementations disclosed herein include a method performed by a device. While executing a CGR application, the method includes displaying a three-dimensional object in a three-dimensional space, wherein the three-dimensional space is defined by a three-dimensional coordinate system. The method also includes: detecting a first user input directed to the three-dimensional object; and in response to detecting the first user input, displaying a spatial manipulation user interface element including a set of spatial manipulation affordances respectively associated with a set of spatial manipulations of the three-dimensional object, wherein each of the set of spatial manipulations corresponds to a translational movement of the three-dimensional object along a corresponding axis of the three-dimensional space.