-
公开(公告)号:US12106062B2
公开(公告)日:2024-10-01
申请号:US17572930
申请日:2022-01-11
Inventor: Zhe Hu , Zhiwei Cao , Jiachen Liu , Xinyan Xiao
CPC classification number: G06F40/40
Abstract: The disclosure provides a method for generating a text. The method includes: obtaining a coding sequence of a first text by coding the first text; obtaining a controllable attribute of a second text to be generated; predicting a hidden state of the second text based on the coding sequence of the first text and the controllable attribute of the second text; and obtaining a second text corresponding to the first text by decoding the coding sequence of the first text based on the hidden state of the second text.
-
公开(公告)号:US20230114673A1
公开(公告)日:2023-04-13
申请号:US18059645
申请日:2022-11-29
Inventor: Wei Li , Xinyan Xiao , Jiachen Liu
Abstract: A method for recognizing a token is performed by an electronic device. The method includes: obtaining first modal data and second modal data; determining a first token of the first modal data and a second token of the second modal data; determining an associated token between the first token and the second token; and recognizing a target shared token between the first modal data and the second modal data based on the first token, the second token and the associated token.
-
公开(公告)号:US12038955B2
公开(公告)日:2024-07-16
申请号:US17652314
申请日:2022-02-24
Inventor: Ao Zhang , Lijie Wang , Xinyan Xiao , Tingting Li
IPC: G06F16/00 , G06F16/33 , G06F16/332
CPC classification number: G06F16/3329 , G06F16/3347
Abstract: The disclosure provides a method for generating a query statement. The method includes: determining a first vector representation based on known nodes in a first syntax tree corresponding to a query statement to be generated; determining a target generation strategy corresponding to a target node to be generated based on the first vector representation and a preset copy reference matrix; generating the target node based on the first vector representation or a second vector representation by performing the target generation strategy, in which the second vector representation is a vector representation corresponding to an adjacent query statement prior to the query statement to be generated; and generating the query statement based on the known nodes and a terminator in response to the target node being the terminator.
-
公开(公告)号:US20220318275A1
公开(公告)日:2022-10-06
申请号:US17808358
申请日:2022-06-23
Inventor: Wei Jia , Dai Dai , Xinyan Xiao
IPC: G06F16/28 , G06F16/2457 , G06K9/62
Abstract: The disclosure provides a search method, an electronic device and a storage medium. The method includes: obtaining a query statement; determining a correlation between the query statement and a candidate result by matching the query statement with a first structured data set corresponding to the candidate result in a search database, in which the first structured data set is generated by performing information extraction on the candidate result by a structured information extraction model generated by training; and determining, based on the correlation, a target search result corresponding to the query statement.
-
公开(公告)号:US12260186B2
公开(公告)日:2025-03-25
申请号:US17992436
申请日:2022-11-22
Inventor: Zhe Hu , Jiachen Liu , Xinyan Xiao
Abstract: A method of generating a text, a method of training a text generation model, an electronic device, and a storage medium, which relate to a field of a computer technology, in particular to fields of deep learning and natural language processing technologies. A specific implementation solution includes: determining a reference feature representation of a target semantic information; determining, based on the reference feature representation and at least one predetermined logical character, at least one sentence latent representation respectively corresponding to the at least one predetermined logical character; and generating a target text content based on the at least one sentence latent representation.
-
6.
公开(公告)号:US11989516B2
公开(公告)日:2024-05-21
申请号:US17572068
申请日:2022-01-10
Inventor: Lijie Wang , Shuai Zhang , Xinyan Xiao , Yue Chang , Tingting Li
IPC: G06F40/289 , G06N20/00
CPC classification number: G06F40/289 , G06N20/00
Abstract: The present disclosure provides a method and apparatus for acquiring a pre-trained model, an electronic device and a storage medium, and relates to the field of artificial intelligence, such as the natural language processing field, the deep learning field, or the like. The method may include: adding, in a process of training a pre-trained model using training sentences, a learning objective corresponding to syntactic information for a self-attention module in the pre-trained model; and training the pre-trained model according to the defined learning objective. The solution of the present disclosure may improve a performance of the pre-trained model, and reduce consumption of computing resources, or the like.
-
公开(公告)号:US12093297B2
公开(公告)日:2024-09-17
申请号:US17577561
申请日:2022-01-18
Inventor: Wenhao Wu , Wei Li , Xinyan Xiao , Jiachen Liu
CPC classification number: G06F16/345 , G06F40/51 , G06F40/56
Abstract: The present disclosure provides a summary generation model training method and apparatus, a device and a storage medium, and relates to the field of computer technologies, and in particular, to the field of artificial intelligence such as natural language processing and deep learning. The summary generation model training method includes: acquiring a document representation corresponding to a document sample; constructing, based on the document representation, a summary representation corresponding to the document representation, the summary representation including a positive summary representation and a negative summary representation; and constructing a total contrastive loss function based on the document representation, the positive summary representation and the negative summary representation, and training a summary generation model based on the total contrastive loss function. The present disclosure may improve accuracy of the summary generation model.
-
公开(公告)号:US20230084438A1
公开(公告)日:2023-03-16
申请号:US17992436
申请日:2022-11-22
Inventor: Zhe Hu , Jiachen Liu , Xinyan Xiao
Abstract: A method of generating a text, a method of training a text generation model, an electronic device, and a storage medium, which relate to a field of a computer technology, in particular to fields of deep learning and natural language processing technologies. A specific implementation solution includes: determining a reference feature representation of a target semantic information; determining, based on the reference feature representation and at least one predetermined logical character, at least one sentence latent representation respectively corresponding to the at least one predetermined logical character; and generating a target text content based on the at least one sentence latent representation.
-
公开(公告)号:US20230004721A1
公开(公告)日:2023-01-05
申请号:US17655770
申请日:2022-03-21
Inventor: Shuai Zhang , Lijie Wang , Xinyan Xiao , Yue Chang
IPC: G06F40/30 , G06F40/211 , G06F40/284
Abstract: Disclosed are a method for training a semantic representation model, a device and a storage medium, which relate to the field of computer technologies, and particularly to the field of artificial intelligence, such as a natural language processing technology, a deep learning technology, or the like. The method for training a semantic representation model includes: obtaining an anchor sample based on a sentence, and obtaining a positive sample and a negative sample based on syntactic information of the sentence; processing the anchor sample, the positive sample and the negative sample using the semantic representation model respectively, so as to obtain an anchor-sample semantic representation, a positive-sample semantic representation and a negative-sample semantic representation; constructing a contrast loss function based on the anchor-sample semantic representation, the positive-sample semantic representation, and the negative-sample semantic representation; and training the semantic representation model based on the contrast loss function.
-
10.
公开(公告)号:US20220327809A1
公开(公告)日:2022-10-13
申请号:US17809133
申请日:2022-06-27
Inventor: Wei Li , Can Gao , Guocheng Niu , Xinyan Xiao , Hao Liu , Jiachen Liu , Hua Wu , Haifeng Wang
IPC: G06V10/778 , G06V10/774 , G06V10/26 , G06F40/284
Abstract: A method for training a model based on multi-modal data joint learning, includes: obtaining multi-modal data; in which the multi-modal data include at least one type of single-modal data and at least one type of Pair multi-modal data; inputting the single-modal data and the Pair multi-modal data into a decoupling attention Transformer network model to generate respectively Token semantic representation features and cross-modal semantic representation features; and training the decoupling attention Transformer network model based on the Token semantic representation features and the cross-modal semantic representation features.
-
-
-
-
-
-
-
-
-