公开(公告)号：US11282516B2

公开(公告)日：2022-03-22

申请号：US16278679

申请日：2019-02-18

Applicant: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.

Inventor： Shuangshuang Qiao ,  Kun Liu ,  Yang Liang ,  Xiangyue Lin ,  Chao Han ,  Mingfa Zhu ,  Jiangliang Guo ,  Xu Li ,  Jun Liu ,  Shuo Li ,  Shiming Yin

IPC: G10L15/22 ,  G10L15/24 ,  G10L25/63 ,  G06V40/16

Abstract: Embodiments of the present disclosure provide a human-machine interaction processing method, an apparatus thereof, a user terminal, a processing server and a system. On the user terminal side, the method includes: receiving an interaction request voice inputted from a user, and collecting video data of the user when inputting the interaction request voice; obtaining an interaction response voice corresponding to the interaction request voice, where the interaction response voice is obtained according to expression information of the user when inputting the interaction request voice and included in the video data; and outputting the interaction response voice to the user. The method imbues the interaction response voice with an emotional tone that matches the current emotion of the user, so that the human-machine interaction process is no longer monotonous, greatly enhancing the user experience.

公开(公告)号：US11138903B2

公开(公告)日：2021-10-05

申请号：US16278690

申请日：2019-02-18

Applicant: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.

Inventor： Xiangyue Lin ,  Kun Liu ,  Shuangshuang Qiao ,  Yang Liang ,  Chao Han ,  Mingfa Zhu ,  Jiangliang Guo ,  Xu Li ,  Jun Liu ,  Shuo Li ,  Shiming Yin

IPC: G09B21/00 ,  G06F40/58 ,  G06K9/00

Abstract: The present disclosure provides a method, an apparatus, a device and a system for sign language translation, where a server receives video information sent by a terminal device, and preprocesses the video information to obtain at least one sign language action; the at least one sign language action is input into a sign language model for classification and prediction to obtain a word corresponding to the at least one sign language action; each word is input into a language model to determine whether an intention expression is complete; and each word is sent to the terminal device when the intention expression is complete, so that the terminal device displays each word, thereby realizing the translation of the sign language action into text, enabling the ordinary persons to better understand intentions of the hearing impaired, thus improving efficiency of communications.