Invention Grant
- Patent Title: Using machine-learning models to determine movements of a mouth corresponding to live speech
-
Application No.: US16887418Application Date: 2020-05-29
-
Publication No.: US11211060B2Publication Date: 2021-12-28
- Inventor: Wilmot Li , Jovan Popovic , Deepali Aneja , David Simons
- Applicant: Adobe Inc.
- Applicant Address: US CA San Jose
- Assignee: Adobe Inc.
- Current Assignee: Adobe Inc.
- Current Assignee Address: US CA San Jose
- Agency: Kilpatrick Townsend & Stockton LLP
- Main IPC: G10L15/197
- IPC: G10L15/197 ; G06N3/04 ; G06N3/08 ; G10L15/02 ; G10L15/06 ; G10L21/0316 ; G10L25/21 ; G10L25/24

Abstract:
Disclosed systems and methods predict visemes from an audio sequence. In an example, a viseme-generation application accesses a first audio sequence that is mapped to a sequence of visemes. The first audio sequence has a first length and represents phonemes. The application adjusts a second length of a second audio sequence such that the second length equals the first length and represents the phonemes. The application adjusts the sequence of visemes to the second audio sequence such that phonemes in the second audio sequence correspond to the phonemes in the first audio sequence. The application trains a machine-learning model with the second audio sequence and the sequence of visemes. The machine-learning model predicts an additional sequence of visemes based on an additional sequence of audio.
Public/Granted literature
- US20200294495A1 USING MACHINE-LEARNING MODELS TO DETERMINE MOVEMENTS OF A MOUTH CORRESPONDING TO LIVE SPEECH Public/Granted day:2020-09-17
Information query