公开(公告)号：US11836836B2

公开(公告)日：2023-12-05

申请号：US17527068

申请日：2021-11-15

Applicant: Beijing Baidu Netcom Science Technology Co., Ltd.

Inventor： Shaoxiong Yang

IPC: G06T13/20 ,  G06T17/20 ,  G06N3/04 ,  G06N3/08 ,  G06N3/045

CPC classification number: G06T13/20 ,  G06N3/045 ,  G06N3/08 ,  G06T17/20

Abstract: Methods and apparatuses for generating a model and generating a 3D animation, devices, and storage mediums are provided. The method for generating a model may include: acquiring a preset sample set; acquiring pre-established generative adversarial nets, the generative adversarial nets including a generator and a discriminator; and performing training steps as follows: selecting a sample from the sample set; extracting a sample audio feature from the sample audio of the sample; inputting the sample audio feature into the generator to obtain a pseudo 3D mesh vertex sequence of the sample; inputting the pseudo 3D mesh vertex sequence and the real 3D mesh vertex sequence of the sample into the discriminator to discriminate authenticity of 3D mesh vertices; and in response to determining that the generative adversarial nets meet a training completion condition, obtaining a trained generator as a model for generating a 3D animation.

公开(公告)号：US11830236B2

公开(公告)日：2023-11-28

申请号：US17456367

申请日：2021-11-23

Applicant: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.

Inventor： Shaoxiong Yang

IPC: G06V10/75 ,  G06V40/16 ,  G06V10/32 ,  G06V10/50 ,  G06V10/24 ,  G06T11/00

CPC classification number: G06V10/7515 ,  G06T11/00 ,  G06V10/242 ,  G06V10/32 ,  G06V10/50 ,  G06V40/161 ,  G06V40/171

Abstract: Provided are a method and a device for generating an avatar, an electronic equipment, a medium and a product. In the method, a to-be-detected face image of a current user is acquired. The to-be-detected face image is analyzed and at least one original component of the to-be-detected face image is obtained. Each original component of the at least one original component of the to-be-detected face image is matched with each candidate component in a component set corresponding to the each original component, and a target component corresponding to the each original component of the to-be-detected face image is obtained. The target component corresponding to the each original component of the to-be-detected face image is assembled into a personalized avatar of the current user.

公开(公告)号：US20220180584A1

公开(公告)日：2022-06-09

申请号：US17527473

申请日：2021-11-16

Applicant: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.

Inventor： Shaoxiong Yang ,  Yang Zhao ,  Chen Zhao

IPC: G06T13/40 ,  G06T13/20 ,  G06K9/00 ,  G10L15/26

Abstract: The present disclosure discloses a method and apparatus for generating animation. An implementation of the method may include: processing a to-be-processed material to generate a normalized text; analyzing the normalized text to generate a Chinese pinyin sequence of the normalized text; generating a reference audio based on the to-be-processed material; and obtaining a animation of facial expressions corresponding to the timing sequence of the reference audio based on the Chinese pinyin sequence and the reference audio.

公开(公告)号：US11948236B2

公开(公告)日：2024-04-02

申请号：US17527473

申请日：2021-11-16

Applicant: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.

Inventor： Shaoxiong Yang ,  Yang Zhao ,  Chen Zhao

IPC: G06T13/40 ,  G06T13/20 ,  G06V20/40 ,  G06V40/16 ,  G10L15/26

CPC classification number: G06T13/40 ,  G06T13/205 ,  G06V20/46 ,  G06V40/165 ,  G06V40/171 ,  G06V40/174 ,  G10L15/26

Abstract: The present disclosure discloses a method and apparatus for generating animation. An implementation of the method may include: processing a to-be-processed material to generate a normalized text; analyzing the normalized text to generate a Chinese pinyin sequence of the normalized text; generating a reference audio based on the to-be-processed material; and obtaining a animation of facial expressions corresponding to the timing sequence of the reference audio based on the Chinese pinyin sequence and the reference audio.