-
公开(公告)号:US11797889B1
公开(公告)日:2023-10-24
申请号:US17557288
申请日:2021-12-21
Applicant: Apple Inc.
Inventor: Edward S. Ahn , Siva Chandra Mouli Sivapurapu , Mark Drummond , Aashi Manglik , Shaun Budhram , Behrooz Mahasseni
Abstract: In one implementation, a method for modeling a behavior with synthetic training data. The method includes: obtaining source content that includes an entity performing one or more actions within an environment; generating a first environment characterization vector characterizing the environment; generating a first set of behavioral trajectories associated with the one or more actions of the entity based on the source content and the first characterization vector for the environment; generating a second environment characterization vector for the environment by perturbing the first environment characterization vector; generating a second set of behavioral trajectories associated with one or more potential actions of the entity based on the source content and the second characterization vector for the environment; and training a behavior model for a virtual agent based on the first and second sets of behavioral trajectories in order to imitate the entity.
-
公开(公告)号:US20230169711A1
公开(公告)日:2023-06-01
申请号:US18102177
申请日:2023-01-27
Applicant: Apple Inc.
Inventor: Behrooz Mahasseni , Aashi Manglik , Mark Drummond , Edward S. Ahn , Shaun Budhram , Siva Chandra Mouli Sivapurapu
CPC classification number: G06T13/40 , G06N3/04 , G06T19/006
Abstract: In one implementation, a method for generating a blended animation. The method includes: obtaining a motion input vector for a current time period; generating a motion output vector and pose information for the current time period based on the motion input vector; selecting an animated motion from a bank of animated motions for the current time period that matches the pose information within a threshold tolerance value; obtaining a blending coefficients vector for the current time period; generating a blended animation for the current time period by blending the motion output vector with the animated motion based on the blending coefficients vector; and generating a reward signal for the blended animation for the current time period.
-
公开(公告)号:US11776193B1
公开(公告)日:2023-10-03
申请号:US17215115
申请日:2021-03-29
Applicant: Apple Inc.
Inventor: Siva Chandra Mouli Sivapurapu , Aashi Manglik , Edward S. Ahn , Mark Drummond
CPC classification number: G06T13/80 , G06T7/251 , G06T13/40 , G06T2207/20081 , G06T2207/20084 , G06T2207/30241
Abstract: Various implementations disclosed herein include devices, systems, and methods for granular motion control for a virtual agent. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, a method includes obtaining an action for a virtual agent. In some implementations, the action is associated with a plurality of time frames. In some implementations, the method includes, for a first time frame of the plurality of time frames, determining respective confidence scores for a plurality of granular motions that advance the virtual agent towards completion of the action. In some implementations, the method includes selecting a subset of the plurality of granular motions based on the respective confidence scores.
-
公开(公告)号:US20230089049A1
公开(公告)日:2023-03-23
申请号:US17853557
申请日:2022-06-29
Applicant: Apple Inc.
Inventor: Mark E. Drummond , Daniel L. Kovacs , Shaun D. Budhram , Edward Ahn , Behrooz Mahasseni , Aashi Manglik , Payal Jotwani , Mu Qiao , Bo Morgan , Noah Gamboa , Michael J. Gutensohn , Dan Feng , Siva Chandra Mouli Sivapurapu
IPC: G06T19/00
Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.
-
公开(公告)号:US20250054249A1
公开(公告)日:2025-02-13
申请号:US18926113
申请日:2024-10-24
Applicant: Apple Inc.
Inventor: Mark E. Drummond , Daniel L. Kovacs , Shaun D. Budhram , Edward Ahn , Behrooz Mahasseni , Aashi Manglik , Payal Jotwani , Mu Qiao , Bo Morgan , Noah Gamboa , Michael J. Gutensohn , Dan Feng , Siva Chandra Mouli Sivapurapu
IPC: G06T19/00
Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.
-
公开(公告)号:US20240020905A1
公开(公告)日:2024-01-18
申请号:US18237625
申请日:2023-08-24
Applicant: Apple Inc.
Inventor: Siva Chandra Mouli Sivapurapu , Aashi Manglik , Edward S. Ahn , Mark Drummond
CPC classification number: G06T13/80 , G06T7/251 , G06T13/40 , G06T2207/20084 , G06T2207/30241 , G06T2207/20081
Abstract: Various implementations disclosed herein include devices, systems, and methods for granular motion control for a virtual agent. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, a method includes obtaining an action for a virtual agent. In some implementations, the action is associated with a plurality of time frames. In some implementations, the method includes, for a first time frame of the plurality of time frames, determining respective confidence scores for a plurality of granular motions that advance the virtual agent towards completion of the action. In some implementations, the method includes selecting a subset of the plurality of granular motions based on the respective confidence scores.
-
公开(公告)号:US11430308B1
公开(公告)日:2022-08-30
申请号:US17242856
申请日:2021-04-28
Applicant: Apple Inc.
Inventor: Jian Zhang , Siva Chandra Mouli Sivapurapu , Aashi Manglik , Amritpal Singh Saini , Edward S. Ahn
Abstract: A method includes obtaining, by a motion generator that has been trained to generate torque values for a plurality of joints of a rig associated with a target, a set of parameters associated with a target motion. The method includes, in response to the target motion being a first type of motion, generating a first set of torque values for the plurality of joints based on the set of parameters and a set of previous poses of the target. The method includes, in response to the target motion being a second type of motion, generating a second set of torque values for the plurality of joints based on the set of parameters and the set of previous poses of the target. The method includes triggering a movement of the target in accordance with the first set of torque values or the second set of torque values.
-
公开(公告)号:US20230350536A1
公开(公告)日:2023-11-02
申请号:US18113020
申请日:2023-02-22
Applicant: Apple Inc.
Inventor: Dan Feng , Aashi Manglik , Adam M. O'Hern , Bo Morgan , Bradley W. Peebler , Daniel L. Kovacs , Edward Ahn , James Moll , Mark E. Drummond , Michelle Chua , Mu Qiao , Noah Gamboa , Payal Jotwani , Siva Chandra Mouli Sivapurapu
IPC: G06F3/04815 , G06T17/00 , G10L15/22 , G06F3/01
CPC classification number: G06F3/04815 , G06T17/00 , G10L15/22 , G06F3/017 , G10L2015/223
Abstract: Various implementations disclosed herein include devices, systems, and methods for selecting a point-of-view (POV) for displaying an environment. In some implementations, a device includes a display, one or more processors, and a non-transitory memory. In some implementations, a method includes obtaining a request to display a graphical environment. The graphical environment is associated with a set of saliency values corresponding to respective portions of the graphical environment. A POV for displaying the graphical environment is selected based on the set of saliency values. The graphical environment is displayed from the selected POV on the display.
-
公开(公告)号:US11593982B1
公开(公告)日:2023-02-28
申请号:US17557273
申请日:2021-12-21
Applicant: Apple Inc.
Inventor: Behrooz Mahasseni , Aashi Manglik , Mark Drummond , Edward S. Ahn , Shaun Budhram , Siva Chandra Mouli Sivapurapu
Abstract: In one implementation, a method for generating a blended animation. The method includes: obtaining a motion input vector for a current time period; generating a motion output vector and pose information for the current time period based on the motion input vector; selecting an animated motion from a bank of animated motions for the current time period that matches the pose information within a threshold tolerance value; obtaining a blending coefficients vector for the current time period; generating a blended animation for the current time period by blending the motion output vector with the animated motion based on the blending coefficients vector; and generating a reward signal for the blended animation for the current time period.
-
公开(公告)号:US11430170B1
公开(公告)日:2022-08-30
申请号:US17173480
申请日:2021-02-11
Applicant: Apple Inc.
Inventor: Siva Chandra Mouli Sivapurapu , Edward S. Ahn , Mark Drummond , Aashi Manglik
Abstract: A method includes obtaining video data including a representation of a first plurality of motions of a real-world entity. The method includes determining, from the video data, a plurality of estimated torque values using a motion controller. The plurality of estimated torque values is associated with a plurality of real-world joints corresponding to the first plurality of motions. The method includes generating a second plurality of motions of a virtual agent by providing the plurality of estimated torque values to a corresponding plurality of virtual joints of the virtual agent. Movement of the virtual agent is controllable by the plurality of virtual joints, corresponding to the plurality of real-world joints of the real-world entity. The method includes, responsive to a determination that a comparison between the first plurality of motions and the second plurality of motions does not satisfy a performance metric, changing an operational value of the motion controller.
-
-
-
-
-
-
-
-
-