-
公开(公告)号:US12210678B2
公开(公告)日:2025-01-28
申请号:US18381472
申请日:2023-10-18
Applicant: Apple Inc.
Inventor: Mu Qiao , Dan Feng , Bo Morgan , Mark E. Drummond
Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.
-
公开(公告)号:US12008720B1
公开(公告)日:2024-06-11
申请号:US17746218
申请日:2022-05-17
Applicant: Apple Inc.
Inventor: Bo Morgan , Payal Jotwani , Angela Blechschmidt , Mark E. Drummond , Daniel Ulbricht
CPC classification number: G06T19/003 , G06T2200/24 , G06T2210/61
Abstract: In one implementation, a method of achieving an objective using a scene graph includes identifying a set of transition couples of a plurality of transition couples between sets of spatial relationships of the scene graph, wherein each spatial relationship of a respective first set of spatial relationships indicated by each transition couple of the set of transition couples is included in an initial set of spatial relationships or an respective second set of spatial relationships indicated by a previous transition couple and wherein a particular spatial relationship is included in a respective second set of spatial relationships of a last transition couple of the set of transition couples.
-
公开(公告)号:US11699270B2
公开(公告)日:2023-07-11
申请号:US17740052
申请日:2022-05-09
Applicant: Apple Inc.
Inventor: Bo Morgan , Mark E. Drummond , Peter Meier , Cameron J. Dunn , John Christopher Russell , Siva Chandra Mouli Sivapurapu , Ian M. Richter
CPC classification number: G06T19/006 , A63F13/55 , G06F3/011 , G06F40/14
Abstract: In various implementations, a device surveys a scene and presents, within the scene, a extended reality (XR) environment including one or more assets that evolve over time (e.g., change location or age). Modeling such an XR environment at various timescales can be computationally intensive, particularly when modeling the XR environment over larger timescales. Accordingly, in various implementations, different models are used to determine the environment state of the XR environment when presenting the XR environment at different timescales.
-
公开(公告)号:US20230162450A1
公开(公告)日:2023-05-25
申请号:US17880262
申请日:2022-08-03
Applicant: Apple Inc.
Inventor: Michael J. Gutensohn , Siva Chandra Mouli Sivapurapu , Mark E. Drummond , Daniel L. Kovacs
CPC classification number: G06T19/006 , G06F3/011 , G06T2210/12
Abstract: Various implementations disclosed herein include a method performed by an electronic device including one or more processors and a non-transitory memory. The method includes obtaining first environmental data that characterizes a first physical setting that is spatially distinct from a second physical setting. The second physical setting includes the electronic device. The method includes generating, using the first environmental data, a first extended reality (XR) environment corresponding to the first physical setting. The method includes generating a first mapping between a first bounding surface of the second physical setting and a first bounding surface of the first XR environment.
-
公开(公告)号:US20230089049A1
公开(公告)日:2023-03-23
申请号:US17853557
申请日:2022-06-29
Applicant: Apple Inc.
Inventor: Mark E. Drummond , Daniel L. Kovacs , Shaun D. Budhram , Edward Ahn , Behrooz Mahasseni , Aashi Manglik , Payal Jotwani , Mu Qiao , Bo Morgan , Noah Gamboa , Michael J. Gutensohn , Dan Feng , Siva Chandra Mouli Sivapurapu
IPC: G06T19/00
Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.
-
公开(公告)号:US20230026511A1
公开(公告)日:2023-01-26
申请号:US17848818
申请日:2022-06-24
Applicant: Apple Inc.
Inventor: Mu Qiao , Dan Feng , Bo Morgan , Mark E. Drummond
Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.
-
公开(公告)号:US12169902B2
公开(公告)日:2024-12-17
申请号:US17853557
申请日:2022-06-29
Applicant: Apple Inc.
Inventor: Mark E. Drummond , Daniel L Kovacs , Shaun D. Budhram , Edward Ahn , Behrooz Mahasseni , Aashi Manglik , Payal Jotwani , Mu Qiao , Bo Morgan , Noah Gamboa , Michael J. Gutensohn , Dan Feng , Siva Chandra Mouli Sivapurapu
IPC: G06T19/00
Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.
-
公开(公告)号:US20240094815A1
公开(公告)日:2024-03-21
申请号:US18523324
申请日:2023-11-29
Applicant: Apple Inc.
Inventor: Michael J. Gutensohn , Payal Jotwani , Mark E. Drummond , Daniel L. Kovacs
IPC: G06F3/01
CPC classification number: G06F3/013
Abstract: In one implementation, a method for recording an XR environment. The method includes: presenting, via the display device, a graphical environment with one or more virtual agents, wherein the graphical environment corresponds to a composition of extended reality (XR) content, including the one or more virtual agents, and an image stream of a physical environment captured from a first point-of-view (POV) of the physical environment; detecting, via the one or more input devices, a user input selecting a first virtual agent from among the one or more virtual agents; and in response to detecting the user input, recording a plurality of data streams associated with the graphical environment including a first image stream of the graphical environment from the first POV and one or more data streams of the graphical environment from a current POV of the first virtual agent.
-
公开(公告)号:US20240045501A1
公开(公告)日:2024-02-08
申请号:US18381472
申请日:2023-10-18
Applicant: Apple Inc.
Inventor: Mu Qiao , Dan Feng , Bo Morgan , Mark E. Drummond
CPC classification number: G06F3/013 , G02B27/017 , G02B2027/0138 , G02B2027/0178
Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.
-
公开(公告)号:US11822716B2
公开(公告)日:2023-11-21
申请号:US17848818
申请日:2022-06-24
Applicant: Apple Inc.
Inventor: Mu Qiao , Dan Feng , Bo Morgan , Mark E. Drummond
CPC classification number: G06F3/013 , G02B27/017 , G02B2027/0138 , G02B2027/0178
Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.
-
-
-
-
-
-
-
-
-