Responding to representations of physical elements

    公开(公告)号:US12277621B2

    公开(公告)日:2025-04-15

    申请号:US17465334

    申请日:2021-09-02

    Applicant: Apple Inc.

    Abstract: In some implementations, a method includes obtaining, by a virtual intelligent agent (VIA), a perceptual property vector (PPV) for a graphical representation of a physical element. In some implementations, the PPV includes one or more perceptual characteristic values characterizing the graphical representation of the physical element. In some implementations, the method includes instantiating a graphical representation of the VIA in a graphical environment that includes the graphical representation of the physical element and an affordance that is associated with the graphical representation of the physical element. In some implementations, the method includes generating, by the VIA, an action for the graphical representation of the VIA based on the PPV. In some implementations, the method includes displaying a manipulation of the affordance by the graphical representation of the VIA in order to effectuate the action generated by the VIA.

    Methods and Systems for Composing and Executing a Scene

    公开(公告)号:US20250054249A1

    公开(公告)日:2025-02-13

    申请号:US18926113

    申请日:2024-10-24

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

    Modeling a physical environment based on saliency

    公开(公告)号:US11869144B1

    公开(公告)日:2024-01-09

    申请号:US17678229

    申请日:2022-02-23

    Applicant: Apple Inc.

    CPC classification number: G06T17/00 G06T15/04 G06V10/462

    Abstract: In some implementations, a device includes one or more sensors, one or more processors and a non-transitory memory. In some implementations, a method includes determining that a first portion of a physical environment is associated with a first saliency value and a second portion of the physical environment is associated with a second saliency value that is different from the first saliency value. In some implementations, the method includes obtaining, via the one or more sensors, environmental data corresponding to the physical environment. In some implementations, the method includes generating, based on the environmental data, a model of the physical environment by modeling the first portion with a first set of modeling features that is a function of the first saliency value and modeling the second portion with a second set of modeling features that is a function of the second saliency value.

    PLANNER FOR AN OBJECTIVE-EFFECTUATOR

    公开(公告)号:US20220262081A1

    公开(公告)日:2022-08-18

    申请号:US17685471

    申请日:2022-03-03

    Applicant: Apple Inc.

    Abstract: In some implementations, a method includes obtaining an objective for a computer-generated reality (CGR) representation of an objective-effectuator. In some implementations, the objective is associated with a plurality of time frames. In some implementations, the method includes determining a plurality of candidate plans that satisfy the objective. In some implementations, the method includes selecting a first candidate plan of the plurality of candidate plans based on a selection criterion. In some implementations, the method includes effectuating the first candidate plan in order to satisfy the objective. In some implementations, the first candidate plan triggers the CGR representation of the objective-effectuator to perform a series of actions over the plurality of time frames associated with the objective.

    Perpetual Property Vector for an Object

    公开(公告)号:US20210398359A1

    公开(公告)日:2021-12-23

    申请号:US17465320

    申请日:2021-09-02

    Applicant: Apple Inc.

    Abstract: In some implementations, a method includes obtaining a semantic construction of a physical environment. In some implementations, the semantic construction of the physical environment includes a representation of a physical element and a semantic label for the physical element. In some implementations, the method includes obtaining a graphical representation of the physical element. In some implementations, the method includes synthesizing a perceptual property vector (PPV) for the graphical representation of the physical element based on the semantic label for the physical element. In some implementations, the PPV includes one or more perceptual characteristic values characterizing the graphical representation of the physical element. In some implementations, the method includes compositing an affordance in association with the graphical representation of the physical element. In some implementations, the affordance allows interaction with the graphical representation of the physical element in accordance with the perceptual characteristic values included in the PPV.

    Methods and systems for composing and executing a scene

    公开(公告)号:US12169902B2

    公开(公告)日:2024-12-17

    申请号:US17853557

    申请日:2022-06-29

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.

    Directing a Virtual Agent Based on Eye Behavior of a User

    公开(公告)号:US20240045501A1

    公开(公告)日:2024-02-08

    申请号:US18381472

    申请日:2023-10-18

    Applicant: Apple Inc.

    CPC classification number: G06F3/013 G02B27/017 G02B2027/0138 G02B2027/0178

    Abstract: According to various implementations, a method is performed at an electronic device including one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a virtual agent that is associated with a first viewing frustum. The first viewing frustum includes a user avatar associated with a user, and the user avatar includes a visual representation of one or more eyes. The method includes, while displaying the virtual agent associated with the first viewing frustum, obtaining eye tracking data that is indicative of eye behavior associated with an eye of the user, updating the visual representation of one or more eyes based on the eye behavior, and directing the virtual agent to perform an action based on the updating and scene information associated with the electronic device.

Patent Agency Ranking