公开(公告)号：US20230004717A1

公开(公告)日：2023-01-05

申请号：US17572068

申请日：2022-01-10

Applicant: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.

Inventor： Lijie WANG ,  Shuai ZHANG ,  Xinyan XIAO ,  Yue CHANG ,  Tingting LI

IPC: G06F40/289 ,  G06N20/00

Abstract: The present disclosure provides a method and apparatus for acquiring a pre-trained model, an electronic device and a storage medium, and relates to the field of artificial intelligence, such as the natural language processing field, the deep learning field, or the like. The method may include: adding, in a process of training a pre-trained model using training sentences, a learning objective corresponding to syntactic information for a self-attention module in the pre-trained model; and training the pre-trained model according to the defined learning objective. The solution of the present disclosure may improve a performance of the pre-trained model, and reduce consumption of computing resources, or the like.

公开(公告)号：US20220215180A1

公开(公告)日：2022-07-07

申请号：US17643053

申请日：2021-12-07

Applicant: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD

Inventor： Jianglu Hu ,  Hehan LI ,  Huifeng SUN ,  Shuqi SUN ,  Yue CHANG ,  Tingting LI ,  Hua WU ,  Haifeng WANG

IPC: G06F40/35 ,  G06F16/332

Abstract: The disclosure provides a method for generating a dialogue. The method includes: obtaining an input sentence; determining a type of a task-based response sentence that is to be generated, by updating a current dialogue state based on the input sentence; generating the task-based response sentence by inputting the input sentence into a task-based dialogue response generator; and determining the task-based response sentence as a target response sentence in response to the type of the task-based response sentence being a designated type.

公开(公告)号：US20230196141A1

公开(公告)日：2023-06-22

申请号：US17972672

申请日：2022-10-25

Applicant: Beijing Baidu Netcom Science Technology Co., Ltd.

Inventor： Hao YUAN ,  Jianglu HU ,  Huifeng SUN ,  Shuqi SUN ,  Yue CHANG ,  Tingting LI

IPC: G06N5/04

CPC classification number: G06N5/04

Abstract: Provided are a data processing method for a dialogue system, an apparatus, a device and a medium. The method includes: obtaining a pre-configured task description, wherein the task description comprises at least one task name and at least one task attribute corresponding to a respective task name; extracting, based on a reading comprehension technique, an answer corresponding to the task description from content of a current dialogue with a user; and completing the dialogue with the user according to the answer and a pre-generated dialogue flow.

公开(公告)号：US20230004798A1

公开(公告)日：2023-01-05

申请号：US17825303

申请日：2022-05-26

Applicant: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.

Inventor： Hongyang ZHANG ,  Zhenyu JIAO ,  Shuqi SUN ,  Yue CHANG ,  Tingting LI

IPC: G06N3/08 ,  G06F40/279 ,  G06F40/30

Abstract: The present disclosure provides intent recognition model training and intent recognition methods and apparatuses, and relates to the field of artificial intelligence technologies. The intent recognition model training method includes: acquiring training data including a plurality of training texts and first annotation intents of the plurality of training texts; constructing a neural network model including a feature extraction layer and a first recognition layer; and training the neural network model according to word segmentation results of the plurality of training texts and the first annotation intents of the plurality of training texts to obtain an intent recognition model. The method for intent recognition includes: acquiring a to-be-recognized text; and inputting word segmentation results of the to-be-recognized text to an intent recognition model, and obtaining a first intent result and a second intent result of the to-be-recognized text according to an output result of the intent recognition model.

公开(公告)号：US20220179889A1

公开(公告)日：2022-06-09

申请号：US17652314

申请日：2022-02-24

Applicant: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.

Inventor： Ao ZHANG ,  Lijie WANG ,  Xinyan XIAO ,  Tingting LI

IPC: G06F16/332 ,  G06F16/33

Abstract: The disclosure provides a method for generating a query statement. The method includes: determining a first vector representation based on known nodes in a first syntax tree corresponding to a query statement to be generated; determining a target generation strategy corresponding to a target node to be generated based on the first vector representation and a preset copy reference matrix; generating the target node based on the first vector representation or a second vector representation by performing the target generation strategy, in which the second vector representation is a vector representation corresponding to an adjacent query statement prior to the query statement to be generated; and generating the query statement based on the known nodes and a terminator in response to the target node being the terminator.