Directing a virtual agent based on eye behavior of a user

    公开(公告)号:US12210678B2

    公开(公告)日:2025-01-28

    申请号:US18381472

    申请日:2023-10-18

    Applicant: Apple Inc.

    Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.

    Scene graph assisted navigation
    12.
    发明授权

    公开(公告)号:US12008720B1

    公开(公告)日:2024-06-11

    申请号:US17746218

    申请日:2022-05-17

    Applicant: Apple Inc.

    CPC classification number: G06T19/003 G06T2200/24 G06T2210/61

    Abstract: In one implementation, a method of achieving an objective using a scene graph includes identifying a set of transition couples of a plurality of transition couples between sets of spatial relationships of the scene graph, wherein each spatial relationship of a respective first set of spatial relationships indicated by each transition couple of the set of transition couples is included in an initial set of spatial relationships or an respective second set of spatial relationships indicated by a previous transition couple and wherein a particular spatial relationship is included in a respective second set of spatial relationships of a last transition couple of the set of transition couples.

    Connecting Spatially Distinct Settings
    14.
    发明公开

    公开(公告)号:US20230162450A1

    公开(公告)日:2023-05-25

    申请号:US17880262

    申请日:2022-08-03

    Applicant: Apple Inc.

    CPC classification number: G06T19/006 G06F3/011 G06T2210/12

    Abstract: Various implementations disclosed herein include a method performed by an electronic device including one or more processors and a non-transitory memory. The method includes obtaining first environmental data that characterizes a first physical setting that is spatially distinct from a second physical setting. The second physical setting includes the electronic device. The method includes generating, using the first environmental data, a first extended reality (XR) environment corresponding to the first physical setting. The method includes generating a first mapping between a first bounding surface of the second physical setting and a first bounding surface of the first XR environment.

    Methods and Systems for Composing and Executing a Scene

    公开(公告)号:US20230089049A1

    公开(公告)日:2023-03-23

    申请号:US17853557

    申请日:2022-06-29

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

    Directing a Virtual Agent Based on Eye Behavior of a User

    公开(公告)号:US20230026511A1

    公开(公告)日:2023-01-26

    申请号:US17848818

    申请日:2022-06-24

    Applicant: Apple Inc.

    Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.

    Methods and systems for composing and executing a scene

    公开(公告)号:US12169902B2

    公开(公告)日:2024-12-17

    申请号:US17853557

    申请日:2022-06-29

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

    METHOD AND DEVICE FOR DEBUGGING PROGRAM EXECUTION AND CONTENT PLAYBACK

    公开(公告)号:US20240094815A1

    公开(公告)日:2024-03-21

    申请号:US18523324

    申请日:2023-11-29

    Applicant: Apple Inc.

    CPC classification number: G06F3/013

    Abstract: In one implementation, a method for recording an XR environment. The method includes: presenting, via the display device, a graphical environment with one or more virtual agents, wherein the graphical environment corresponds to a composition of extended reality (XR) content, including the one or more virtual agents, and an image stream of a physical environment captured from a first point-of-view (POV) of the physical environment; detecting, via the one or more input devices, a user input selecting a first virtual agent from among the one or more virtual agents; and in response to detecting the user input, recording a plurality of data streams associated with the graphical environment including a first image stream of the graphical environment from the first POV and one or more data streams of the graphical environment from a current POV of the first virtual agent.

    Directing a Virtual Agent Based on Eye Behavior of a User

    公开(公告)号:US20240045501A1

    公开(公告)日:2024-02-08

    申请号:US18381472

    申请日:2023-10-18

    Applicant: Apple Inc.

    CPC classification number: G06F3/013 G02B27/017 G02B2027/0138 G02B2027/0178

    Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.

    Directing a virtual agent based on eye behavior of a user

    公开(公告)号:US11822716B2

    公开(公告)日:2023-11-21

    申请号:US17848818

    申请日:2022-06-24

    Applicant: Apple Inc.

    CPC classification number: G06F3/013 G02B27/017 G02B2027/0138 G02B2027/0178

    Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.

Patent Agency Ranking