-
公开(公告)号:US20240070951A1
公开(公告)日:2024-02-29
申请号:US17894984
申请日:2022-08-24
Applicant: Disney Enterprises, Inc.
Inventor: Sanchita Tiwari , Justin Ali Kennedy , Mark R. Brashear , Daniel Cahall , Dumene Comploi , Dirk Van Dall , Keith Comito
CPC classification number: G06T13/40 , G06N20/00 , G06T13/80 , G06T2213/12
Abstract: A system for producing conversation-driven character animation includes a computing platform having processing hardware and a system memory storing software code, the software code including multiple trained machine learning (ML) models. The processing hardware executes the software code to obtain a conversation understanding feature set describing a present state of a conversation between a digital character and a system user, and to generate an inference, using at least a first trained ML model of the multiple trained ML models and the conversation understanding feature set, the inference including labels describing a predicted next state of a scene within the conversation. The processing hardware further executes the software code to produce, using at least a second trained ML model of the multiple trained ML models and the labels, an animation stream of the digital character participating in the predicted next state of the scene within the conversation.
-
公开(公告)号:US11622146B2
公开(公告)日:2023-04-04
申请号:US17064235
申请日:2020-10-06
Applicant: Disney Enterprises, Inc.
Inventor: Keith Comito , Dirk Van Dall , James Bowers , Anthony Waters , Thomas Engel
IPC: H04N21/43 , H04N21/8547 , G11B27/10 , H04N21/41
Abstract: According to one implementation, a method of guiding an interaction between a companion module and a user includes identifying a media content for playout by a media player device, transmitting, to a remote server, an interaction schema request identifying the media content and the companion module, and receiving, from the remote server, behavioral manifest data including an instruction for guiding the interaction between the companion module and the user. Such a method also includes obtaining a play head state of the media player device and a playout timecode state of the media content, and identifying a user interaction behavior for the companion module based on the behavioral manifest data, the play head state of the media player device, and the playout timecode state of the media content.
-
公开(公告)号:US12041289B2
公开(公告)日:2024-07-16
申请号:US18116216
申请日:2023-03-01
Applicant: Disney Enterprises, Inc.
Inventor: Keith Comito , Dirk Van Dall , James Bowers , Anthony Waters , Thomas Engel
IPC: H04N21/43 , G11B27/10 , H04N21/41 , H04N21/8547
CPC classification number: H04N21/4302 , G11B27/10 , H04N21/4104 , H04N21/8547
Abstract: According to one implementation, a method of guiding an interaction between a companion module and a user includes identifying a media content for playout by a media player device, transmitting, to a remote server, an interaction schema request identifying the media content and the companion module, and receiving, from the remote server, behavioral manifest data including an instruction for guiding the interaction between the companion module and the user. Such a method also includes obtaining a play head state of the media player device and a playout timecode state of the media content, and identifying a user interaction behavior for the companion module based on the behavioral manifest data, the play head state of the media player device, and the playout timecode state of the media content.
-
公开(公告)号:US20240070399A1
公开(公告)日:2024-02-29
申请号:US17894967
申请日:2022-08-24
Applicant: Disney Enterprises, Inc.
Inventor: Sanchita Tiwari , Justin Ali Kennedy , Dirk Van Dall , Xiuyang Yu , Daniel Cahall , Brian Kazmierczak
IPC: G06F40/35 , G06F40/284 , G06F40/289 , G06N20/00 , G10L13/08 , G10L25/63
CPC classification number: G06F40/35 , G06F40/284 , G06F40/289 , G06N20/00 , G10L13/08 , G10L25/63
Abstract: A system for emotionally enhancing dialogue includes a computing platform having processing hardware and a system memory storing a software code including a predictive model. The processing hardware is configured to execute the software code to receive dialogue data identifying an utterance for use by a digital character in a conversation, analyze, using the dialogue data, an emotionality of the utterance at multiple structural levels of the utterance, and supplement the utterance with one or more emotional attributions, using the predictive model and the emotionality of the utterance at the multiple structural levels, to provide one or more candidate emotionally enhanced utterance(s). The processing hardware further executes the software code to perform an audio validation of the candidate emotionally enhanced utterance(s) to provide a validated emotionally enhanced utterance, and output an emotionally attributed dialogue data providing the validated emotionally enhanced utterance for use by the digital character in the conversation.
-
公开(公告)号:US20230252994A1
公开(公告)日:2023-08-10
申请号:US17666286
申请日:2022-02-07
Applicant: Disney Enterprises, Inc.
Inventor: Sanchita Tiwari , Xiuyang Yu , Justin Ali Kennedy , Dirk Van Dall
IPC: G10L15/26 , G10L15/02 , G06F40/279 , G06N20/00
CPC classification number: G10L15/26 , G10L15/02 , G06F40/279 , G06N20/00 , G10L2015/025
Abstract: A system includes a computing platform including processing hardware and a system memory storing software code. The processing hardware executes the software code to receive a transcript of speech by a user, generate a phoneme stream corresponding to the transcript, partition the phoneme stream into words, and aggregate subsets of the words to form candidate sentences. The software code is further executed to determine, using one or both of an entity identified in the transcript and a history of the user, one or both of a user intent and a context of the speech by the user, rank the candidate sentences and the transcript based on one or both of the user intent and the context of the speech by the user, and identify, based on the ranking, one of the candidate sentences or the transcript as the best transcription of the speech by the user.
-
公开(公告)号:US11790652B2
公开(公告)日:2023-10-17
申请号:US17972095
申请日:2022-10-24
Applicant: Disney Enterprises, Inc.
Inventor: Justin Ali Kennedy , Kevin John Prince , Carlos Augusto Dietrich , Dirk Van Dall
Abstract: Systems and methods are presented for detecting physical contacts effectuated by actions performed by an entity participating in an event. An action, performed by the entity, is detected based on a sequence of pose data associated with the entity's performance in the event. A contact with another entity in the event is detected based on data associated with the detected action. The action and the contact detections are employed by neural-network based detectors.
-
公开(公告)号:US11748558B2
公开(公告)日:2023-09-05
申请号:US17081906
申请日:2020-10-27
Applicant: Disney Enterprises, Inc.
Inventor: Sanchita Tiwari , Xiuyang Yu , Brian Kazmierczak , Dirk Van Dall
CPC classification number: G06F40/20 , G06N3/045 , G06N3/08 , G06V40/174 , A63F13/58 , G09B7/00 , G10L15/1822 , G10L17/26
Abstract: A system providing a multi-persona social agent includes a computing platform having a hardware processor, a system memory storing a software code, and multiple neural network (NN) based predictive models accessible by the software code. The hardware processor executes the software code to receive input data corresponding to an interaction with a user, determine a generic expression for use in the interaction, and identify one of the character personas as a persona to be assumed by the multi-persona social agent. The software code also generates, using the generic expression and one of the NN based predictive models corresponding to the persona to be assumed by the multi-persona social agent, a sentiment driven personified response for the interaction with the user based on a vocabulary, phrases, and one or more syntax rules idiosyncratic to the persona to be assumed, and renders the sentiment driven personified response using the multi-persona social agent.
-
公开(公告)号:US20220109905A1
公开(公告)日:2022-04-07
申请号:US17064235
申请日:2020-10-06
Applicant: Disney Enterprises, Inc.
Inventor: Keith Comito , Dirk Van Dall , James Bowers , Anthony Waters , Thomas Engel
IPC: H04N21/43 , H04N21/41 , G11B27/10 , H04N21/8547
Abstract: According to one implementation, a method of guiding an interaction between a companion module and a user includes identifying a media content for playout by a media player device, transmitting, to a remote server, an interaction schema request identifying the media content and the companion module, and receiving, from the remote server, behavioral manifest data including an instruction for guiding the interaction between the companion module and the user. Such a method also includes obtaining a play head state of the media player device and a playout timecode state of the media content, and identifying a user interaction behavior for the companion module based on the behavioral manifest data, the play head state of the media player device, and the playout timecode state of the media content.
-
公开(公告)号:US11741756B2
公开(公告)日:2023-08-29
申请号:US17972021
申请日:2022-10-24
Applicant: Disney Enterprises, Inc.
Inventor: Kevin John Prince , Carlos Augusto Dietrich , Dirk Van Dall
Abstract: Systems and methods are presented for generating statistics associated with a performance of a participant in an event, wherein pose data associated with the participant, performing in the event, are processed in real time. Pose data associated with the participant may comprise positional data of a skeletal representation of the participant. Actions performed by the participant may be determined based on a comparison of segments of the participant's pose data to motion patterns associated with actions of interests.
-
公开(公告)号:US20230069401A1
公开(公告)日:2023-03-02
申请号:US17972021
申请日:2022-10-24
Applicant: Disney Enterprises, Inc.
Inventor: Kevin John Prince , Carlos Augusto Dietrich , Dirk Van Dall
Abstract: Systems and methods are presented for generating statistics associated with a performance of a participant in an event, wherein pose data associated with the participant, performing in the event, are processed in real time. Pose data associated with the participant may comprise positional data of a skeletal representation of the participant. Actions performed by the participant may be determined based on a comparison of segments of the participant's pose data to motion patterns associated with actions of interests.
-
-
-
-
-
-
-
-
-