Invention Application
- Patent Title: VIRTUAL OBJECT LIP DRIVING METHOD, MODEL TRAINING METHOD, RELEVANT DEVICES AND ELECTRONIC DEVICE
-
Application No.: US17883037Application Date: 2022-08-08
-
Publication No.: US20220383574A1Publication Date: 2022-12-01
- Inventor: Zhanwang ZHANG , Tianshu HU , Zhibin HONG , Zhiliang XU
- Applicant: Beijing Baidu Netcom Science Technology Co., Ltd.
- Applicant Address: CN Beijing
- Assignee: Beijing Baidu Netcom Science Technology Co., Ltd.
- Current Assignee: Beijing Baidu Netcom Science Technology Co., Ltd.
- Current Assignee Address: CN Beijing
- Priority: CN202111261314.3 20211028
- Main IPC: G06T13/00
- IPC: G06T13/00 ; G10L15/02 ; G10L15/04 ; G06V10/774 ; G06V40/16 ; G06T7/11 ; G06T5/50 ; G10L15/25

Abstract:
A virtual object lip driving method performed by an electronic device includes: obtaining a speech segment and target face image data about a virtual object; and inputting the speech segment and the target face image data into a first target model to perform a first lip driving operation, so as to obtain first lip image data about the virtual object driven by the speech segment. The first target model is trained in accordance with a first model and a second model, the first model is a lip-speech synchronization discriminative model with respect to lip image data, and the second model is a lip-speech synchronization discriminative model with respect to a lip region in the lip image data.
Information query