-
公开(公告)号:US20250054249A1
公开(公告)日:2025-02-13
申请号:US18926113
申请日:2024-10-24
Applicant: Apple Inc.
Inventor: Mark E. Drummond , Daniel L. Kovacs , Shaun D. Budhram , Edward Ahn , Behrooz Mahasseni , Aashi Manglik , Payal Jotwani , Mu Qiao , Bo Morgan , Noah Gamboa , Michael J. Gutensohn , Dan Feng , Siva Chandra Mouli Sivapurapu
IPC: G06T19/00
Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.
-
公开(公告)号:US12182327B2
公开(公告)日:2024-12-31
申请号:US18523324
申请日:2023-11-29
Applicant: Apple Inc.
Inventor: Michael J. Gutensohn , Payal Jotwani , Mark E. Drummond , Daniel L. Kovacs
IPC: G06F3/01
Abstract: In one implementation, a method for recording an XR environment. The method includes: presenting, via the display device, a graphical environment with one or more virtual agents, wherein the graphical environment corresponds to a composition of extended reality (XR) content, including the one or more virtual agents, and an image stream of a physical environment captured from a first point-of-view (POV) of the physical environment; detecting, via the one or more input devices, a user input selecting a first virtual agent from among the one or more virtual agents; and in response to detecting the user input, recording a plurality of data streams associated with the graphical environment including a first image stream of the graphical environment from the first POV and one or more data streams of the graphical environment from a current POV of the first virtual agent.
-
公开(公告)号:US11869144B1
公开(公告)日:2024-01-09
申请号:US17678229
申请日:2022-02-23
Applicant: Apple Inc.
Inventor: Payal Jotwani , Bo Morgan , Behrooz Mahasseni , Bradley W. Peebler , Dan Feng , Mark E. Drummond , Siva Chandra Mouli Sivapurapu
CPC classification number: G06T17/00 , G06T15/04 , G06V10/462
Abstract: In some implementations, a device includes one or more sensors, one or more processors and a non-transitory memory. In some implementations, a method includes determining that a first portion of a physical environment is associated with a first saliency value and a second portion of the physical environment is associated with a second saliency value that is different from the first saliency value. In some implementations, the method includes obtaining, via the one or more sensors, environmental data corresponding to the physical environment. In some implementations, the method includes generating, based on the environmental data, a model of the physical environment by modeling the first portion with a first set of modeling features that is a function of the first saliency value and modeling the second portion with a second set of modeling features that is a function of the second saliency value.
-
公开(公告)号:US11868526B2
公开(公告)日:2024-01-09
申请号:US17703278
申请日:2022-03-24
Applicant: Apple Inc.
Inventor: Michael J. Gutensohn , Payal Jotwani , Mark E. Drummond , Daniel L. Kovacs
IPC: G06F3/01
CPC classification number: G06F3/013
Abstract: In one implementation, a method for recording an XR environment. The method includes: presenting, via the display device, a graphical environment with one or more virtual agents, wherein the graphical environment corresponds to a composition of extended reality (XR) content, including the one or more virtual agents, and an image stream of a physical environment captured from a first point-of-view (POV) of the physical environment; detecting, via the one or more input devices, a user input selecting a first virtual agent from among the one or more virtual agents; and in response to detecting the user input, recording a plurality of data streams associated with the graphical environment including a first image stream of the graphical environment from the first POV and one or more data streams of the graphical environment from a current POV of the first virtual agent.
-
公开(公告)号:US20230350536A1
公开(公告)日:2023-11-02
申请号:US18113020
申请日:2023-02-22
Applicant: Apple Inc.
Inventor: Dan Feng , Aashi Manglik , Adam M. O'Hern , Bo Morgan , Bradley W. Peebler , Daniel L. Kovacs , Edward Ahn , James Moll , Mark E. Drummond , Michelle Chua , Mu Qiao , Noah Gamboa , Payal Jotwani , Siva Chandra Mouli Sivapurapu
IPC: G06F3/04815 , G06T17/00 , G10L15/22 , G06F3/01
CPC classification number: G06F3/04815 , G06T17/00 , G10L15/22 , G06F3/017 , G10L2015/223
Abstract: Various implementations disclosed herein include devices, systems, and methods for selecting a point-of-view (POV) for displaying an environment. In some implementations, a device includes a display, one or more processors, and a non-transitory memory. In some implementations, a method includes obtaining a request to display a graphical environment. The graphical environment is associated with a set of saliency values corresponding to respective portions of the graphical environment. A POV for displaying the graphical environment is selected based on the set of saliency values. The graphical environment is displayed from the selected POV on the display.
-
公开(公告)号:US11373377B2
公开(公告)日:2022-06-28
申请号:US17203393
申请日:2021-03-16
Applicant: Apple Inc.
Inventor: Bo Morgan , Mark E. Drummond , Peter Meier , Cameron J. Dunn , John Christopher Russell , Siva Chandra Mouli Sivapurapu , Ian M. Richter
Abstract: In various implementations, a device surveys a scene and presents, within the scene, a extended reality (XR) environment including one or more assets that evolve over time (e.g., change location or age). Modeling such an XR environment at various timescales can be computationally intensive, particularly when modeling the XR environment over larger timescales. Accordingly, in various implementations, different models are used to determine the environment state of the XR environment when presenting the XR environment at different timescales.
-
公开(公告)号:US12056581B1
公开(公告)日:2024-08-06
申请号:US16786097
申请日:2020-02-10
Applicant: Apple Inc.
Inventor: Novaira Masood , Bo Morgan , Shem Nguyen , Mark E. Drummond
Abstract: Various implementations disclosed herein include devices, systems, and methods for training of an action determining component of a computer character. In some implementations, actions are taken by the character in a 3D environment according to an action determining component of the character, where the character is rewarded or penalized for interactions associated with an object/concept in the 3D environment according to an assigned object/concept reward or penalty. In some implementations, the reward or the penalty assigned to the object/concept is modified, and the character is then rewarded or penalized for interactions associated with the object/concept according to the modified reward or the modified penalty. The action determining component of the character is trained using a reinforcement learning technique that accounts for rewards or penalties obtained by virtual character for interactions associated with the object/concept.
-
公开(公告)号:US20220270335A1
公开(公告)日:2022-08-25
申请号:US17740052
申请日:2022-05-09
Applicant: Apple Inc.
Inventor: Bo Morgan , Mark E. Drummond , Peter Meier , Cameron J. Dunn , John Christopher Russell , Siva Chandra Mouli Sivapurapu , Ian M. Richter
Abstract: In various implementations, a device surveys a scene and presents, within the scene, a extended reality (XR) environment including one or more assets that evolve over time (e.g., change location or age). Modeling such an XR environment at various timescales can be computationally intensive, particularly when modeling the XR environment over larger timescales. Accordingly, in various implementations, different models are used to determine the environment state of the XR environment when presenting the XR environment at different timescales.
-
公开(公告)号:US20210201594A1
公开(公告)日:2021-07-01
申请号:US17203393
申请日:2021-03-16
Applicant: Apple Inc.
Inventor: Bo Morgan , Mark E. Drummond , Peter Meier , Cameron J. Dunn , John Christopher Russell , Siva Chandra Mouli Sivapurapu , Ian M. Richter
Abstract: In various implementations, a device surveys a scene and presents, within the scene, a extended reality (XR) environment including one or more assets that evolve over time (e.g., change location or age). Modeling such an XR environment at various timescales can be computationally intensive, particularly when modeling the XR environment over larger timescales. Accordingly, in various implementations, different models are used to determine the environment state of the XR environment when presenting the XR environment at different timescales.
-
公开(公告)号:US20210201108A1
公开(公告)日:2021-07-01
申请号:US17203374
申请日:2021-03-16
Applicant: Apple Inc.
Inventor: Bo Morgan , Mark E. Drummond , Peter Meier , Cameron J. Dunn , John Christopher Russell , Siva Chandra Mouli Sivapurapu
Abstract: In one implementation, a method of generating an environment state is performed by a device including one or more processors and non-transitory memory. The method includes obtaining a first environment state of an environment, wherein the first environment state indicates the inclusion in the environment of a first asset associated with a first timescale value and a second asset associated with a second timescale value, wherein the first environment state further indicates that the first asset has a first state of the first asset and the second asset has a first state of the second asset. The method includes determining a second state of the first asset and the second asset based on the first and second timescale value. The method includes determining a second environment state that indicates that the first asset has the second state and the second asset has the second state.
-
-
-
-
-
-
-
-
-