-
公开(公告)号：US20210375269A1
公开(公告)日：2021-12-02
申请号：US16999426
申请日：2020-08-21
Applicant: salesforce.com, inc.
Inventor： Semih Yavuz , Kazuma Hashimoto , Wenhao Liu , Nitish Shirish Keskar , Richard Socher , Caiming Xiong
IPC: G10L15/183 , G06N20/00 , G10L15/06 , G06F17/18
Abstract: Embodiments described herein utilize pre-trained masked language models as the backbone for dialogue act tagging and provide cross-domain generalization of the resulting dialogue acting taggers. For example, a pre-trained MASK token of BERT model may be used as a controllable mechanism for augmenting text input, e.g., generating tags for an input of unlabeled dialogue history. The pre-trained MASK model can be trained with semi-supervised learning, e.g., using multiple objectives from supervised tagging loss, masked tagging loss, masked language model loss, and/or a disagreement loss.
-
22.发明申请公开(公告)号：US20210357687A1
公开(公告)日：2021-11-18
申请号：US16931228
申请日：2020-07-16
Applicant: salesforce.com, inc.
Inventor： Mingfei Gao , Yingbo Zhou , Ran Xu , Caiming Xiong
Abstract: Embodiments described herein provide systems and methods for a partially supervised training model for online action detection. Specifically, the online action detection framework may include two modules that are trained jointly—a Temporal Proposal Generator (TPG) and an Online Action Recognizer (OAR). In the training phase, OAR performs both online per-frame action recognition and start point detection. At the same time, TPG generates class-wise temporal action proposals serving as noisy supervisions for OAR. TPG is then optimized with the video-level annotations. In this way, the online action detection framework can be trained with video-category labels only without pre-annotated segment-level boundary labels.
-
公开(公告)号：US20210216828A1
公开(公告)日：2021-07-15
申请号：US17080276
申请日：2020-10-26
Applicant: salesforce.com, inc.
Inventor： Chetan Ramaiah , Peng Tang , Caiming Xiong
Abstract: A method for generating a neural network for detecting one or more objects in images includes generating one or more self-supervised proposal learning losses based on the one or more proposal features and corresponding proposal feature predictions. One or more consistency-based proposal learning losses are generated based on noisy proposal feature predictions and the corresponding proposal predictions without noise. A combined loss is generated using the one or more self-supervised proposal learning losses and one or more consistency-based proposal learning losses. The neural network is updated based on the combined loss.
-
公开(公告)号：US11042796B2
公开(公告)日：2021-06-22
申请号：US15421431
申请日：2017-01-31
Applicant: salesforce.com, inc.
Inventor： Kazuma Hashimoto , Caiming Xiong , Richard Socher
IPC: G06N3/04 , G06N3/08 , G06F40/30 , G06F40/205 , G06F40/216 , G06F40/253 , G06F40/284 , G06N3/063 , G10L15/18 , G10L25/30 , G10L15/16 , G06F40/00
Abstract: The technology disclosed provides a so-called “joint many-task neural network model” to solve a variety of increasingly complex natural language processing (NLP) tasks using growing depth of layers in a single end-to-end model. The model is successively trained by considering linguistic hierarchies, directly connecting word representations to all model layers, explicitly using predictions in lower tasks, and applying a so-called “successive regularization” technique to prevent catastrophic forgetting. Three examples of lower level model layers are part-of-speech (POS) tagging layer, chunking layer, and dependency parsing layer. Two examples of higher level model layers are semantic relatedness layer and textual entailment layer. The model achieves the state-of-the-art results on chunking, dependency parsing, semantic relatedness and textual entailment.
-
公开(公告)号：US20210142103A1
公开(公告)日：2021-05-13
申请号：US16718186
申请日：2019-12-18
Applicant: salesforce.com, inc.
Inventor： Tian Xie , Kazuma Hashimoto , Xinyi Yang , Caiming Xiong
IPC: G06K9/62 , G06N5/04 , G06F40/216
Abstract: An online system that allows users to interact with it using expressions in natural language form includes an intent inference module allowing it to infer an intent represented by a user expression. The intent inference module has a set of possible intents, along with a small set of example natural language expressions known to represent that intent. When a user interacts with the system using a natural language expression for which the intent is not already known, the intent inference module applies a natural language inference model to compute scores indicating whether the user expression textually entails the various example natural language expressions. Based on the scores, the intent inference module determines an intent that is most applicable for the expression. If an intent cannot be determined with sufficient confidence, the intent inference module may further attempt to determine whether the various example natural language expressions textually entail the user expression.
-
Patent Agency Ranking
公开(公告)号：US20210073459A1
公开(公告)日：2021-03-11
申请号：US17027130
申请日：2020-09-21
Applicant: salesforce.com, inc.
Inventor： Bryan McCann , Caiming Xiong , Richard Socher
IPC: G06F40/126 , G06N3/08 , G06N3/04 , G06F40/30 , G06F40/47 , G06F40/205 , G06F40/289
Abstract: A system is provided for natural language processing. In some embodiments, the system includes an encoder for generating context-specific word vectors for at least one input sequence of words. The encoder is pre-trained using training data for performing a first natural language processing task. A neural network performs a second natural language processing task on the at least one input sequence of words using the context-specific word vectors. The first natural language process task is different from the second natural language processing task and the neural network is separately trained from the encoder. In some embodiments, the first natural processing task can be machine translation, and the second natural processing task can be one of sentiment analysis, question classification, entailment classification, and question answering
-
公开(公告)号：US10909157B2
公开(公告)日：2021-02-02
申请号：US16051188
申请日：2018-07-31
Applicant: salesforce.com, inc.
Inventor： Romain Paulus , Wojciech Kryscinski , Caiming Xiong
Abstract: A system is disclosed for providing an abstractive summary of a source textual document. The system includes an encoder, a decoder, and a fusion layer. The encoder is capable of generating an encoding for the source textual document. The decoder is separated into a contextual model and a language model. The contextual model is capable of extracting words from the source textual document using the encoding. The language model is capable of generating vectors paraphrasing the source textual document based on pre-training with a training dataset. The fusion layer is capable of generating the abstractive summary of the source textual document from the extracted words and the generated vectors for paraphrasing. In some embodiments, the system utilizes a novelty metric to encourage the generation of novel phrases for inclusion in the abstractive summary.
-
28.发明授权公开(公告)号：US10565306B2
公开(公告)日：2020-02-18
申请号：US15817165
申请日：2017-11-18
Applicant: salesforce.com, inc.
Inventor： Jiasen Lu , Caiming Xiong , Richard Socher
Abstract: The technology disclosed presents a novel spatial attention model that uses current hidden state information of a decoder long short-term memory (LSTM) to guide attention and to extract spatial image features for use in image captioning. The technology disclosed also presents a novel adaptive attention model for image captioning that mixes visual information from a convolutional neural network (CNN) and linguistic information from an LSTM. At each timestep, the adaptive attention model automatically decides how heavily to rely on the image, as opposed to the linguistic model, to emit the next caption word. The technology disclosed further adds a new auxiliary sentinel gate to an LSTM architecture and produces a sentinel LSTM (Sn-LSTM). The sentinel gate produces a visual sentinel at each timestep, which is an additional representation, derived from the LSTM's memory, of long and short term visual and linguistic information.
-
公开(公告)号：US10565305B2
公开(公告)日：2020-02-18
申请号：US15817161
申请日：2017-11-17
Applicant: salesforce.com, inc.
Inventor： Jiasen Lu , Caiming Xiong , Richard Socher
IPC: G06K9/00 , G06F17/27 , G06K9/62 , G06K9/46 , G06F17/24 , G06K9/48 , G06K9/66 , G06N3/08 , G06N3/04
Abstract: The technology disclosed presents a novel spatial attention model that uses current hidden state information of a decoder long short-term memory (LSTM) to guide attention and to extract spatial image features for use in image captioning. The technology disclosed also presents a novel adaptive attention model for image captioning that mixes visual information from a convolutional neural network (CNN) and linguistic information from an LSTM. At each timestep, the adaptive attention model automatically decides how heavily to rely on the image, as opposed to the linguistic model, to emit the next caption word. The technology disclosed further adds a new auxiliary sentinel gate to an LSTM architecture and produces a sentinel LSTM (Sn-LSTM). The sentinel gate produces a visual sentinel at each timestep, which is an additional representation, derived from the LSTM's memory, of long and short term visual and linguistic information.
-
公开(公告)号：US20190258714A1
公开(公告)日：2019-08-22
申请号：US15978445
申请日：2018-05-14
Applicant: salesforce.com, inc.
Inventor： Victor Zhong , Caiming Xiong
Abstract: A method for maintaining a dialogue state associated with a dialogue between a user and a digital system includes receiving, by a dialogue state tracker associated with the digital system, a representation of a user communication, updating, by the dialogue state tracker, the dialogue state and providing a system response based on the updated dialogue state. The dialogue state is updated by evaluating, based on the representation of the user communication, a plurality of member scores corresponding to a plurality of ontology members of an ontology set, and selecting, based on the plurality of member scores, zero or more of the plurality of ontology members to add to or remove from the dialogue state. The dialogue state tracker includes a global-local encoder that includes a global branch and a local branch, the global branch having global trained parameters that are shared among the plurality of ontology members and the local branch having local trained parameters that are determined separately for each of the plurality of ontology members.
-
-
-
-
-
-
-
-
-
Search Results
184
records
(took 0.054 seconds)
