- 专利标题: LAYER TRAJECTORY LONG SHORT-TERM MEMORY WITH FUTURE CONTEXT
-
申请号: US16410659申请日: 2019-05-13
-
公开(公告)号: US20200334526A1公开(公告)日: 2020-10-22
- 发明人: Jinyu LI , Vadim MAZALOV , Changliang LIU , Liang LU , Yifan GONG
- 申请人: Microsoft Technology Licensing, LLC
- 主分类号: G06N3/08
- IPC分类号: G06N3/08 ; G10L15/22 ; G10L15/16 ; G10L15/183
摘要:
According to some embodiments, a machine learning model may include an input layer to receive an input signal as a series of frames representing handwriting data, speech data, audio data, and/or textual data. A plurality of time layers may be provided, and each time layer may comprise a uni-directional recurrent neural network processing block. A depth processing block may scan hidden states of the recurrent neural network processing block of each time layer, and the depth processing block may be associated with a first frame and receive context frame information of a sequence of one or more future frames relative to the first frame. An output layer may output a final classification as a classified posterior vector of the input signal. For example, the depth processing block may receive the context from information from an output of a time layer processing block or another depth processing block of the future frame.
公开/授权文献
- US11631399B2 Layer trajectory long short-term memory with future context 公开/授权日:2023-04-18
信息查询