-
公开(公告)号：US20180082171A1
公开(公告)日：2018-03-22
申请号：US15421016
申请日：2017-01-31
Applicant: salesforce.com, inc.
Inventor： Stephen Joseph MERITY , Caiming XIONG , James BRADBURY , Richard SOCHER
CPC classification number: G06N3/0445 , G06F17/277 , G06N3/0454 , G06N3/0472 , G06N3/08 , G06N3/084 , G06N7/005
Abstract: The technology disclosed provides a so-called “pointer sentinel mixture architecture” for neural network sequence models that has the ability to either reproduce a token from a recent context or produce a token from a predefined vocabulary. In one implementation, a pointer sentinel-LSTM architecture achieves state of the art language modeling performance of 70.9 perplexity on the Penn Treebank dataset, while using far fewer parameters than a standard softmax LSTM.
-
公开(公告)号：US20210103816A1
公开(公告)日：2021-04-08
申请号：US17122894
申请日：2020-12-15
Applicant: salesforce.com, inc.
Inventor： James BRADBURY , Stephen Joseph MERITY , Caiming XIONG , Richard SOCHER
Abstract: The technology disclosed provides a quasi-recurrent neural network (QRNN) encoder-decoder model that alternates convolutional layers, which apply in parallel across timesteps, and minimalist recurrent pooling layers that apply in parallel across feature dimensions.
-
公开(公告)号：US20180129931A1
公开(公告)日：2018-05-10
申请号：US15420801
申请日：2017-01-31
Applicant: salesforce.com, inc.
Inventor： James BRADBURY , Stephen Joseph MERITY , Caiming XIONG , Richard SOCHER
IPC: G06N3/04
CPC classification number: G06N3/08 , G06F17/16 , G06F17/20 , G06F17/2715 , G06F17/2785 , G06F17/2818 , G06N3/04 , G06N3/0445 , G06N3/0454 , G06N3/10 , G10L15/16 , G10L15/18 , G10L15/1815 , G10L25/30
Abstract: The technology disclosed provides a quasi-recurrent neural network (QRNN) encoder-decoder model that alternates convolutional layers, which apply in parallel across timesteps, and minimalist recurrent pooling layers that apply in parallel across feature dimensions.
-
-
Search Results
3
records
(took 0.013 seconds)
