-
1.发明申请公开(公告)号：US20250014589A1
公开(公告)日：2025-01-09
申请号：US18889390
申请日：2024-09-19
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor： Yaoyuan Wang , Ziyang Zhang , Minglei Li , Weihua He , Yuhan Zhang , Haifeng Xing
Abstract: In a model training method, a computing device generates an initial virtual human speaking video based on an audio data set and a person speaking video. The computing device trains a lip synchronization parameter generation model based on the audio data set and a lip synchronization training parameter used as a model training label. The computing device then uses the lip synchronization parameter generation model to generate a lip synchronization parameter based on input audio, and the lip synchronization parameter is used to drive a virtual human to speak. The computing device expands a data amount of the lip synchronization training parameter by using the initial virtual human speaking video.
-
公开(公告)号：US20250014255A1
公开(公告)日：2025-01-09
申请号：US18886730
申请日：2024-09-16
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor： Ziyang Zhang , Yaoyuan Wang , Minglei Li , Weihua He , Yuhan Zhang , Jie Cheng
Abstract: A rendering model training method and apparatus are provided. A related video rendering method and apparatus, a device, and a storage medium are also provided. The rendering model training method includes: obtaining a first video including a face of a target object; mapping a facial action of the target object in the first video based on a three-dimensional face model, to obtain a second video including a three-dimensional face; and training an initial rendering model by using the second video as an input of the initial rendering model and using the first video as supervision of an output of the initial rendering model, to obtain a target rendering model. The second video generated based on the three-dimensional face model is used as a sample for training the rendering model.
-
Search Results
2
records
(took 0.052 seconds)
