Invention Publication
- Patent Title: END-TO-END VIRTUAL HUMAN SPEECH AND MOVEMENT SYNTHESIZATION
-
Application No.: US18342721Application Date: 2023-06-27
-
Publication No.: US20240221260A1Publication Date: 2024-07-04
- Inventor: Dimitar Petkov Dinev , Ondrej Texler , Siddarth Ravichandran , Janvi Chetan Palan , Hyun Jae Kang , Ankur Gupta , Anil Unnikrishnan , Anthony Sylvain Jean-Yves Liot , Sajid Sadi
- Applicant: SAMSUNG ELECTRONICS CO., LTD.
- Applicant Address: KR Gyeonggi-Do
- Assignee: SAMSUNG ELECTRONICS CO., LTD.
- Current Assignee: SAMSUNG ELECTRONICS CO., LTD.
- Current Assignee Address: KR Gyeonggi-Do
- Main IPC: G06T13/40
- IPC: G06T13/40 ; G06T13/20 ; G06T19/20 ; G06V40/16 ; G06V40/20

Abstract:
Synthesizing speech and movement of a virtual human includes capturing supplemental data generated by a transducer. The supplemental data specifies one or more attributes of a user. The capturing is performed in substantially real-time with the user providing input to a conversational platform. A behavior determiner generates behavioral data based on the supplemental data and an audio response generated by the conversational platform in response to the input to the conversation platform. Based on the behavioral data and the audio response, a rendering network generates a video rendering of a virtual human engaging in a conversation with the user, the video rendering synchronized with the audio response.
Information query