Conversation-Driven Character Animation
    1.
    发明公开

    公开(公告)号:US20240070951A1

    公开(公告)日:2024-02-29

    申请号:US17894984

    申请日:2022-08-24

    CPC classification number: G06T13/40 G06N20/00 G06T13/80 G06T2213/12

    Abstract: A system for producing conversation-driven character animation includes a computing platform having processing hardware and a system memory storing software code, the software code including multiple trained machine learning (ML) models. The processing hardware executes the software code to obtain a conversation understanding feature set describing a present state of a conversation between a digital character and a system user, and to generate an inference, using at least a first trained ML model of the multiple trained ML models and the conversation understanding feature set, the inference including labels describing a predicted next state of a scene within the conversation. The processing hardware further executes the software code to produce, using at least a second trained ML model of the multiple trained ML models and the labels, an animation stream of the digital character participating in the predicted next state of the scene within the conversation.

    Guided interaction between a companion device and a user

    公开(公告)号:US11622146B2

    公开(公告)日:2023-04-04

    申请号:US17064235

    申请日:2020-10-06

    Abstract: According to one implementation, a method of guiding an interaction between a companion module and a user includes identifying a media content for playout by a media player device, transmitting, to a remote server, an interaction schema request identifying the media content and the companion module, and receiving, from the remote server, behavioral manifest data including an instruction for guiding the interaction between the companion module and the user. Such a method also includes obtaining a play head state of the media player device and a playout timecode state of the media content, and identifying a user interaction behavior for the companion module based on the behavioral manifest data, the play head state of the media player device, and the playout timecode state of the media content.

    Guided interaction between a companion device and a user

    公开(公告)号:US12041289B2

    公开(公告)日:2024-07-16

    申请号:US18116216

    申请日:2023-03-01

    CPC classification number: H04N21/4302 G11B27/10 H04N21/4104 H04N21/8547

    Abstract: According to one implementation, a method of guiding an interaction between a companion module and a user includes identifying a media content for playout by a media player device, transmitting, to a remote server, an interaction schema request identifying the media content and the companion module, and receiving, from the remote server, behavioral manifest data including an instruction for guiding the interaction between the companion module and the user. Such a method also includes obtaining a play head state of the media player device and a playout timecode state of the media content, and identifying a user interaction behavior for the companion module based on the behavioral manifest data, the play head state of the media player device, and the playout timecode state of the media content.

    Multi-Level Emotional Enhancement of Dialogue

    公开(公告)号:US20240070399A1

    公开(公告)日:2024-02-29

    申请号:US17894967

    申请日:2022-08-24

    Abstract: A system for emotionally enhancing dialogue includes a computing platform having processing hardware and a system memory storing a software code including a predictive model. The processing hardware is configured to execute the software code to receive dialogue data identifying an utterance for use by a digital character in a conversation, analyze, using the dialogue data, an emotionality of the utterance at multiple structural levels of the utterance, and supplement the utterance with one or more emotional attributions, using the predictive model and the emotionality of the utterance at the multiple structural levels, to provide one or more candidate emotionally enhanced utterance(s). The processing hardware further executes the software code to perform an audio validation of the candidate emotionally enhanced utterance(s) to provide a validated emotionally enhanced utterance, and output an emotionally attributed dialogue data providing the validated emotionally enhanced utterance for use by the digital character in the conversation.

    Domain and User Intent Specific Disambiguation of Transcribed Speech

    公开(公告)号:US20230252994A1

    公开(公告)日:2023-08-10

    申请号:US17666286

    申请日:2022-02-07

    Abstract: A system includes a computing platform including processing hardware and a system memory storing software code. The processing hardware executes the software code to receive a transcript of speech by a user, generate a phoneme stream corresponding to the transcript, partition the phoneme stream into words, and aggregate subsets of the words to form candidate sentences. The software code is further executed to determine, using one or both of an entity identified in the transcript and a history of the user, one or both of a user intent and a context of the speech by the user, rank the candidate sentences and the transcript based on one or both of the user intent and the context of the speech by the user, and identify, based on the ranking, one of the candidate sentences or the transcript as the best transcription of the speech by the user.

    Multi-persona social agent
    7.
    发明授权

    公开(公告)号:US11748558B2

    公开(公告)日:2023-09-05

    申请号:US17081906

    申请日:2020-10-27

    Abstract: A system providing a multi-persona social agent includes a computing platform having a hardware processor, a system memory storing a software code, and multiple neural network (NN) based predictive models accessible by the software code. The hardware processor executes the software code to receive input data corresponding to an interaction with a user, determine a generic expression for use in the interaction, and identify one of the character personas as a persona to be assumed by the multi-persona social agent. The software code also generates, using the generic expression and one of the NN based predictive models corresponding to the persona to be assumed by the multi-persona social agent, a sentiment driven personified response for the interaction with the user based on a vocabulary, phrases, and one or more syntax rules idiosyncratic to the persona to be assumed, and renders the sentiment driven personified response using the multi-persona social agent.

    Guided Interaction Between a Companion Device and a User

    公开(公告)号:US20220109905A1

    公开(公告)日:2022-04-07

    申请号:US17064235

    申请日:2020-10-06

    Abstract: According to one implementation, a method of guiding an interaction between a companion module and a user includes identifying a media content for playout by a media player device, transmitting, to a remote server, an interaction schema request identifying the media content and the companion module, and receiving, from the remote server, behavioral manifest data including an instruction for guiding the interaction between the companion module and the user. Such a method also includes obtaining a play head state of the media player device and a playout timecode state of the media content, and identifying a user interaction behavior for the companion module based on the behavioral manifest data, the play head state of the media player device, and the playout timecode state of the media content.

    Real Time Kinematic Analyses of Body Motion

    公开(公告)号:US20230069401A1

    公开(公告)日:2023-03-02

    申请号:US17972021

    申请日:2022-10-24

    Abstract: Systems and methods are presented for generating statistics associated with a performance of a participant in an event, wherein pose data associated with the participant, performing in the event, are processed in real time. Pose data associated with the participant may comprise positional data of a skeletal representation of the participant. Actions performed by the participant may be determined based on a comparison of segments of the participant's pose data to motion patterns associated with actions of interests.

Patent Agency Ranking