公开(公告)号：US20220383574A1

公开(公告)日：2022-12-01

申请号：US17883037

申请日：2022-08-08

Applicant: Beijing Baidu Netcom Science Technology Co., Ltd.

Inventor： Zhanwang ZHANG ,  Tianshu HU ,  Zhibin HONG ,  Zhiliang XU

IPC: G06T13/00 ,  G10L15/02 ,  G10L15/04 ,  G06V10/774 ,  G06V40/16 ,  G06T7/11 ,  G06T5/50 ,  G10L15/25

Abstract: A virtual object lip driving method performed by an electronic device includes: obtaining a speech segment and target face image data about a virtual object; and inputting the speech segment and the target face image data into a first target model to perform a first lip driving operation, so as to obtain first lip image data about the virtual object driven by the speech segment. The first target model is trained in accordance with a first model and a second model, the first model is a lip-speech synchronization discriminative model with respect to lip image data, and the second model is a lip-speech synchronization discriminative model with respect to a lip region in the lip image data.