ENCODER-DECODER MEMORY-AUGMENTED NEURAL NETWORK ARCHITECTURES

    公开(公告)号:US20200090035A1

    公开(公告)日:2020-03-19

    申请号:US16135990

    申请日:2018-09-19

    IPC分类号: G06N3/08 G06N3/04 G06N3/063

    摘要: Memory-augmented neural networks are provided. In various embodiments, an encoder artificial neural network is adapted to receive an input and provide an encoded output based on the input. A plurality of decoder artificial neural networks is provided, each adapted to receive an encoded input and provide an output based on the encoded input. A memory is operatively coupled to the encoder artificial neural network and to the plurality of decoder artificial neural networks. The memory is adapted to store the encoded output of the encoder artificial neural network and provide the encoded input to the plurality of decoder artificial neural networks.

    DISTRIBUTED MEMORY-AUGMENTED NEURAL NETWORK ARCHITECTURE

    公开(公告)号:US20210311874A1

    公开(公告)日:2021-10-07

    申请号:US16838294

    申请日:2020-04-02

    摘要: A method for using a distributed memory device in a memory augmented neural network system includes receiving, by a controller, an input query to access data stored in the distributed memory device, the distributed memory device comprising a plurality of memory banks. The method further includes determining, by the controller, a memory bank selector that identifies a memory bank from the distributed memory device for memory access, wherein the memory bank selector is determined based on a type of workload associated with the input query. The method further includes computing, by the controller and by using content based access, a memory address in the identified memory bank. The method further includes generating, by the controller, an output in response to the input query by accessing the memory address.

    Variational gradient flow
    4.
    发明授权

    公开(公告)号:US11475304B2

    公开(公告)日:2022-10-18

    申请号:US16872907

    申请日:2020-05-12

    摘要: According to embodiments of the present disclosure, methods of and computer program products for operating a plurality of classifiers are provided. A plurality of input entities are read, each input entity having an associated target label. The input entities are provided to a first classifier, and a category of each input entity is obtained therefrom. A feature map is determined for each input entity. Each feature map is provided to each of a set of classifiers, and an assigned label is obtained for each feature map from each of the set of classifiers. Each classifier is associated with one of the categories. For each classifier, the assigned label for each feature map is compared to the target labels to determine a plurality of gradients. The plurality of gradients are masked according to each category, yielding a masked set of gradients for each category. Each classifier is trained according its associated masked gradients.

    VARIATIONAL GRADIENT FLOW
    6.
    发明申请

    公开(公告)号:US20210357743A1

    公开(公告)日:2021-11-18

    申请号:US16872907

    申请日:2020-05-12

    IPC分类号: G06N3/08 G06N3/04

    摘要: According to embodiments of the present disclosure, methods of and computer program products for operating a plurality of classifiers are provided. A plurality of input entities are read, each input entity having an associated target label. The input entities are provided to a first classifier, and a category of each input entity is obtained therefrom. A feature map is determined for each input entity. Each feature map is provided to each of a set of classifiers, and an assigned label is obtained for each feature map from each of the set of classifiers. Each classifier is associated with one of the categories. For each classifier, the assigned label for each feature map is compared to the target labels to determine a plurality of gradients. The plurality of gradients are masked according to each category, yielding a masked set of gradients for each category. Each classifier is trained according its associated masked gradients.