-
1.发明申请公开(公告)号：US20230004717A1
公开(公告)日：2023-01-05
申请号：US17572068
申请日：2022-01-10
Inventor： Lijie WANG , Shuai ZHANG , Xinyan XIAO , Yue CHANG , Tingting LI
IPC: G06F40/289 , G06N20/00
Abstract: The present disclosure provides a method and apparatus for acquiring a pre-trained model, an electronic device and a storage medium, and relates to the field of artificial intelligence, such as the natural language processing field, the deep learning field, or the like. The method may include: adding, in a process of training a pre-trained model using training sentences, a learning objective corresponding to syntactic information for a self-attention module in the pre-trained model; and training the pre-trained model according to the defined learning objective. The solution of the present disclosure may improve a performance of the pre-trained model, and reduce consumption of computing resources, or the like.
-
公开(公告)号：US20220179889A1
公开(公告)日：2022-06-09
申请号：US17652314
申请日：2022-02-24
Inventor： Ao ZHANG , Lijie WANG , Xinyan XIAO , Tingting LI
IPC: G06F16/332 , G06F16/33
Abstract: The disclosure provides a method for generating a query statement. The method includes: determining a first vector representation based on known nodes in a first syntax tree corresponding to a query statement to be generated; determining a target generation strategy corresponding to a target node to be generated based on the first vector representation and a preset copy reference matrix; generating the target node based on the first vector representation or a second vector representation by performing the target generation strategy, in which the second vector representation is a vector representation corresponding to an adjacent query statement prior to the query statement to be generated; and generating the query statement based on the known nodes and a terminator in response to the target node being the terminator.
-
Search Results
2
records
(took 0.015 seconds)
