公开(公告)号：US20250054249A1

公开(公告)日：2025-02-13

申请号：US18926113

申请日：2024-10-24

Applicant: Apple Inc.

Inventor： Mark E. Drummond ,  Daniel L. Kovacs ,  Shaun D. Budhram ,  Edward Ahn ,  Behrooz Mahasseni ,  Aashi Manglik ,  Payal Jotwani ,  Mu Qiao ,  Bo Morgan ,  Noah Gamboa ,  Michael J. Gutensohn ,  Dan Feng ,  Siva Chandra Mouli Sivapurapu

IPC: G06T19/00

Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

公开(公告)号：US12182327B2

公开(公告)日：2024-12-31

申请号：US18523324

申请日：2023-11-29

Applicant: Apple Inc.

Inventor： Michael J. Gutensohn ,  Payal Jotwani ,  Mark E. Drummond ,  Daniel L. Kovacs

IPC: G06F3/01

Abstract: In one implementation, a method for recording an XR environment. The method includes: presenting, via the display device, a graphical environment with one or more virtual agents, wherein the graphical environment corresponds to a composition of extended reality (XR) content, including the one or more virtual agents, and an image stream of a physical environment captured from a first point-of-view (POV) of the physical environment; detecting, via the one or more input devices, a user input selecting a first virtual agent from among the one or more virtual agents; and in response to detecting the user input, recording a plurality of data streams associated with the graphical environment including a first image stream of the graphical environment from the first POV and one or more data streams of the graphical environment from a current POV of the first virtual agent.

公开(公告)号：US11868526B2

公开(公告)日：2024-01-09

申请号：US17703278

申请日：2022-03-24

Applicant: Apple Inc.

Inventor： Michael J. Gutensohn ,  Payal Jotwani ,  Mark E. Drummond ,  Daniel L. Kovacs

IPC: G06F3/01

CPC classification number: G06F3/013

Abstract: In one implementation, a method for recording an XR environment. The method includes: presenting, via the display device, a graphical environment with one or more virtual agents, wherein the graphical environment corresponds to a composition of extended reality (XR) content, including the one or more virtual agents, and an image stream of a physical environment captured from a first point-of-view (POV) of the physical environment; detecting, via the one or more input devices, a user input selecting a first virtual agent from among the one or more virtual agents; and in response to detecting the user input, recording a plurality of data streams associated with the graphical environment including a first image stream of the graphical environment from the first POV and one or more data streams of the graphical environment from a current POV of the first virtual agent.

公开(公告)号：US20230350536A1

公开(公告)日：2023-11-02

申请号：US18113020

申请日：2023-02-22

Applicant: Apple Inc.

Inventor： Dan Feng ,  Aashi Manglik ,  Adam M. O'Hern ,  Bo Morgan ,  Bradley W. Peebler ,  Daniel L. Kovacs ,  Edward Ahn ,  James Moll ,  Mark E. Drummond ,  Michelle Chua ,  Mu Qiao ,  Noah Gamboa ,  Payal Jotwani ,  Siva Chandra Mouli Sivapurapu

IPC: G06F3/04815 ,  G06T17/00 ,  G10L15/22 ,  G06F3/01

CPC classification number: G06F3/04815 ,  G06T17/00 ,  G10L15/22 ,  G06F3/017 ,  G10L2015/223

Abstract: Various implementations disclosed herein include devices, systems, and methods for selecting a point-of-view (POV) for displaying an environment. In some implementations, a device includes a display, one or more processors, and a non-transitory memory. In some implementations, a method includes obtaining a request to display a graphical environment. The graphical environment is associated with a set of saliency values corresponding to respective portions of the graphical environment. A POV for displaying the graphical environment is selected based on the set of saliency values. The graphical environment is displayed from the selected POV on the display.

公开(公告)号：US20240094815A1

公开(公告)日：2024-03-21

申请号：US18523324

申请日：2023-11-29

Applicant: Apple Inc.

Inventor： Michael J. Gutensohn ,  Payal Jotwani ,  Mark E. Drummond ,  Daniel L. Kovacs

IPC: G06F3/01

CPC classification number: G06F3/013

Abstract: In one implementation, a method for recording an XR environment. The method includes: presenting, via the display device, a graphical environment with one or more virtual agents, wherein the graphical environment corresponds to a composition of extended reality (XR) content, including the one or more virtual agents, and an image stream of a physical environment captured from a first point-of-view (POV) of the physical environment; detecting, via the one or more input devices, a user input selecting a first virtual agent from among the one or more virtual agents; and in response to detecting the user input, recording a plurality of data streams associated with the graphical environment including a first image stream of the graphical environment from the first POV and one or more data streams of the graphical environment from a current POV of the first virtual agent.

公开(公告)号：US20220350401A1

公开(公告)日：2022-11-03

申请号：US17703278

申请日：2022-03-24

Applicant: Apple Inc.

Inventor： Michael J. Gutensohn ,  Payal Jotwani ,  Mark E. Drummond ,  Daniel L. Kovacs

IPC: G06F3/01

Abstract: In one implementation, a method for recording an XR environment. The method includes: presenting, via the display device, a graphical environment with one or more virtual agents, wherein the graphical environment corresponds to a composition of extended reality (XR) content, including the one or more virtual agents, and an image stream of a physical environment captured from a first point-of-view (POV) of the physical environment; detecting, via the one or more input devices, a user input selecting a first virtual agent from among the one or more virtual agents; and in response to detecting the user input, recording a plurality of data streams associated with the graphical environment including a first image stream of the graphical environment from the first POV and one or more data streams of the graphical environment from a current POV of the first virtual agent.

公开(公告)号：US20240038228A1

公开(公告)日：2024-02-01

申请号：US18226536

申请日：2023-07-26

Applicant: Apple Inc.

Inventor： Dan Feng ,  Behrooz Mahasseni ,  Bo Morgan ,  Daniel L. Kovacs ,  Mu Qiao

IPC: G10L15/22

CPC classification number: G10L15/22 ,  G10L2015/228

Abstract: In some implementations, a method includes displaying, on a display, an environment that includes a representation of a virtual agent that is associated with a sensory characteristic. In some implementations, the method includes selecting, based on the sensory characteristic associated with the virtual agent, a subset of a plurality of sensors to provide sensor data for the virtual agent. In some implementations, the method includes providing the sensor data captured by the subset of the plurality of sensors to the virtual agent in order to reduce power consumption of the device. In some implementations, the method includes displaying a manipulation of the representation of the virtual agent based on an interpretation of the sensor data by the virtual agent.

公开(公告)号：US20230162450A1

公开(公告)日：2023-05-25

申请号：US17880262

申请日：2022-08-03

Applicant: Apple Inc.

Inventor： Michael J. Gutensohn ,  Siva Chandra Mouli Sivapurapu ,  Mark E. Drummond ,  Daniel L. Kovacs

IPC: G06T19/00 ,  G06F3/01

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06T2210/12

Abstract: Various implementations disclosed herein include a method performed by an electronic device including one or more processors and a non-transitory memory. The method includes obtaining first environmental data that characterizes a first physical setting that is spatially distinct from a second physical setting. The second physical setting includes the electronic device. The method includes generating, using the first environmental data, a first extended reality (XR) environment corresponding to the first physical setting. The method includes generating a first mapping between a first bounding surface of the second physical setting and a first bounding surface of the first XR environment.

公开(公告)号：US20230089049A1

公开(公告)日：2023-03-23

申请号：US17853557

申请日：2022-06-29

Applicant: Apple Inc.

Inventor： Mark E. Drummond ,  Daniel L. Kovacs ,  Shaun D. Budhram ,  Edward Ahn ,  Behrooz Mahasseni ,  Aashi Manglik ,  Payal Jotwani ,  Mu Qiao ,  Bo Morgan ,  Noah Gamboa ,  Michael J. Gutensohn ,  Dan Feng ,  Siva Chandra Mouli Sivapurapu

IPC: G06T19/00

Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.