-
公开(公告)号:US20230169711A1
公开(公告)日:2023-06-01
申请号:US18102177
申请日:2023-01-27
Applicant: Apple Inc.
Inventor: Behrooz Mahasseni , Aashi Manglik , Mark Drummond , Edward S. Ahn , Shaun Budhram , Siva Chandra Mouli Sivapurapu
CPC classification number: G06T13/40 , G06N3/04 , G06T19/006
Abstract: In one implementation, a method for generating a blended animation. The method includes: obtaining a motion input vector for a current time period; generating a motion output vector and pose information for the current time period based on the motion input vector; selecting an animated motion from a bank of animated motions for the current time period that matches the pose information within a threshold tolerance value; obtaining a blending coefficients vector for the current time period; generating a blended animation for the current time period by blending the motion output vector with the animated motion based on the blending coefficients vector; and generating a reward signal for the blended animation for the current time period.
-
公开(公告)号:US20210407185A1
公开(公告)日:2021-12-30
申请号:US17475004
申请日:2021-09-14
Applicant: Apple Inc.
Inventor: Mark Drummond , Bo Morgan , Siva Chandra Mouli Sivapurapu
Abstract: In some implementations, a method includes obtaining environmental data corresponding to a physical environment. In some implementations, the method includes determining, based on the environmental data, a bounding surface of the physical environment. In some implementations, the method includes detecting a physical element located within the physical environment based on the environmental data. In some implementations, the method includes determining a semantic label for the physical element based on at least a portion of the environmental data corresponding to the physical element. In some implementations, the method includes generating a semantic construction of the physical environment based on the environmental data. In some implementations, the semantic construction of the physical environment includes a representation of the bounding surface, a representation of the physical element and the semantic label for the physical element.
-
公开(公告)号:US20210398360A1
公开(公告)日:2021-12-23
申请号:US17465342
申请日:2021-09-02
Applicant: Apple Inc.
Inventor: Mark Drummond , Bo Morgan
Abstract: A method includes determining a first portion of state information that is accessible to a first agent instantiated in an environment. The method includes determining a second portion of the state information that is accessible to a second agent instantiated in the environment. The method includes generating a first set of actions for a representation of the first agent based on the first portion of the state information to satisfy a first objective of the first agent. The method includes generating a second set of actions for a representation of the second agent based on the second portion of the state information to satisfy a second objective of the second agent. The method includes modifying the representations of the first and second agents based on the first and second set of actions.
-
公开(公告)号:US20240020905A1
公开(公告)日:2024-01-18
申请号:US18237625
申请日:2023-08-24
Applicant: Apple Inc.
Inventor: Siva Chandra Mouli Sivapurapu , Aashi Manglik , Edward S. Ahn , Mark Drummond
CPC classification number: G06T13/80 , G06T7/251 , G06T13/40 , G06T2207/20084 , G06T2207/30241 , G06T2207/20081
Abstract: Various implementations disclosed herein include devices, systems, and methods for granular motion control for a virtual agent. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, a method includes obtaining an action for a virtual agent. In some implementations, the action is associated with a plurality of time frames. In some implementations, the method includes, for a first time frame of the plurality of time frames, determining respective confidence scores for a plurality of granular motions that advance the virtual agent towards completion of the action. In some implementations, the method includes selecting a subset of the plurality of granular motions based on the respective confidence scores.
-
公开(公告)号:US20230326205A1
公开(公告)日:2023-10-12
申请号:US18209582
申请日:2023-06-14
Applicant: Apple Inc.
Inventor: Mark Drummond , Payal Jotwani
CPC classification number: G06V20/20 , G06T19/006
Abstract: In one implementation, a method of defining a negative space in a three-dimensional scene model is performed at a device including a processor and non-transitory memory. The method includes obtaining a three-dimensional scene model of a physical environment including a plurality of points, wherein each of the plurality of points is associated with a set of coordinates in a three-dimensional space. The method includes defining a subspace in the three-dimensional space with less than a threshold number of the plurality of points. The method includes determining a semantic label for the subspace. The method includes generating a characterization vector of the subspace, wherein the characterization vector includes the spatial extent of the subspace and the semantic label.
-
公开(公告)号:US20220262081A1
公开(公告)日:2022-08-18
申请号:US17685471
申请日:2022-03-03
Applicant: Apple Inc.
Inventor: Mark Drummond , Siva Chandra Mouli Sivapurapu , Bo Morgan
IPC: G06T19/00 , G06N3/08 , G06F3/04845 , G06N20/00 , G06F3/0482 , G06N5/02
Abstract: In some implementations, a method includes obtaining an objective for a computer-generated reality (CGR) representation of an objective-effectuator. In some implementations, the objective is associated with a plurality of time frames. In some implementations, the method includes determining a plurality of candidate plans that satisfy the objective. In some implementations, the method includes selecting a first candidate plan of the plurality of candidate plans based on a selection criterion. In some implementations, the method includes effectuating the first candidate plan in order to satisfy the objective. In some implementations, the first candidate plan triggers the CGR representation of the objective-effectuator to perform a series of actions over the plurality of time frames associated with the objective.
-
公开(公告)号:US20210398359A1
公开(公告)日:2021-12-23
申请号:US17465320
申请日:2021-09-02
Applicant: Apple Inc.
Inventor: Mark Drummond , Bo Morgan , Siva Chandra Mouli Sivapurapu
Abstract: In some implementations, a method includes obtaining a semantic construction of a physical environment. In some implementations, the semantic construction of the physical environment includes a representation of a physical element and a semantic label for the physical element. In some implementations, the method includes obtaining a graphical representation of the physical element. In some implementations, the method includes synthesizing a perceptual property vector (PPV) for the graphical representation of the physical element based on the semantic label for the physical element. In some implementations, the PPV includes one or more perceptual characteristic values characterizing the graphical representation of the physical element. In some implementations, the method includes compositing an affordance in association with the graphical representation of the physical element. In some implementations, the affordance allows interaction with the graphical representation of the physical element in accordance with the perceptual characteristic values included in the PPV.
-
公开(公告)号:US12141904B1
公开(公告)日:2024-11-12
申请号:US17872860
申请日:2022-07-25
Applicant: Apple Inc.
Inventor: Siva Chandra Mouli Sivapurapu , Edward S. Ahn , Mark Drummond , Aashi Manglik
Abstract: A method includes displaying, via a display device, a virtual agent moving according to a motion type. The virtual agent is defined by a plurality of virtual joints and motions of the virtual agent are controllable by providing a corresponding plurality of torques to the plurality of virtual joints. The method includes, while the virtual agent is moving according to the motion type, registering an interaction event with the virtual agent. The interaction event initiates a change to the motion type. The method includes, in response to registering the interaction event, generating, using a motion controller, a plurality of torque values for the virtual agent based on a function of the motion type and the interaction event, and generating an animation for the virtual agent by providing the plurality of torque values to the plurality of virtual joints of the virtual agent.
-
公开(公告)号:US11954909B2
公开(公告)日:2024-04-09
申请号:US18209582
申请日:2023-06-14
Applicant: Apple Inc.
Inventor: Mark Drummond , Payal Jotwani
CPC classification number: G06V20/20 , G06T19/006
Abstract: In one implementation, a method of defining a negative space in a three-dimensional scene model is performed at a device including a processor and non-transitory memory. The method includes obtaining a three-dimensional scene model of a physical environment including a plurality of points, wherein each of the plurality of points is associated with a set of coordinates in a three-dimensional space. The method includes defining a subspace in the three-dimensional space with less than a threshold number of the plurality of points. The method includes determining a semantic label for the subspace. The method includes generating a characterization vector of the subspace, wherein the characterization vector includes the spatial extent of the subspace and the semantic label.
-
公开(公告)号:US11776192B2
公开(公告)日:2023-10-03
申请号:US18102177
申请日:2023-01-27
Applicant: Apple Inc.
Inventor: Behrooz Mahasseni , Aashi Manglik , Mark Drummond , Edward S. Ahn , Shaun Budhram , Siva Chandra Mouli Sivapurapu
CPC classification number: G06T13/40 , G06N3/04 , G06T19/006
Abstract: In one implementation, a method for generating a blended animation. The method includes: obtaining a motion input vector for a current time period; generating a motion output vector and pose information for the current time period based on the motion input vector; selecting an animated motion from a bank of animated motions for the current time period that matches the pose information within a threshold tolerance value; obtaining a blending coefficients vector for the current time period; generating a blended animation for the current time period by blending the motion output vector with the animated motion based on the blending coefficients vector; and generating a reward signal for the blended animation for the current time period.
-
-
-
-
-
-
-
-
-