MULTI-CORE SYSTOLIC PROCESSOR SYSTEM FOR NEURAL NETWORK PROCESSING

    公开(公告)号:US20190244081A1

    公开(公告)日:2019-08-08

    申请号:US15981735

    申请日:2018-05-16

    IPC分类号: G06N3/04 G06N3/08 G06N5/04

    摘要: A method of computer processing is disclosed comprising receiving a data packet at a processing node of a neural network, performing a calculation of the data packet at the processing node to create a processed data packet, attaching a tag to the processed data packet, transmitting the processed data packet from the processing node to a receiving node during a systolic pulse, receiving the processed data packet at the receiving node, performing a clockwise convolution on the processed data packet and a counter clockwise convolution on the processed data packet, performing an adding function and backpropagating results of the performed sigmoid function to each of the processing nodes that originally processed the data packet.

    RECONFIGURABLE SYSTOLIC NEURAL NETWORK ENGINE

    公开(公告)号:US20190244078A1

    公开(公告)日:2019-08-08

    申请号:US16233968

    申请日:2018-12-27

    IPC分类号: G06N3/04 G06N3/08

    摘要: Some embodiments include a special-purpose hardware accelerator that can perform specialized machine learning tasks during both training and inference stages. For example, this hardware accelerator uses a systolic array having a number of data processing units (“DPUs”) that are each connected to a small number of other DPUs in a local region. Data from the many nodes of a neural network is pulsed through these DPUs with associated tags that identify where such data was originated or processed, such that each DPU has knowledge of where incoming data originated and thus is able to compute the data as specified by the architecture of the neural network. These tags enable the systolic neural network engine to perform computations during backpropagation, such that the systolic neural network engine is able to support training.

    SYSTOLIC NEURAL NETWORK ENGINE CAPABLE OF FORWARD PROPAGATION

    公开(公告)号:US20190244077A1

    公开(公告)日:2019-08-08

    申请号:US15981624

    申请日:2018-05-16

    IPC分类号: G06N3/04 G06N3/08

    摘要: A method of computer processing is disclosed comprising receiving a data packet at a processing node of a neural network, performing a calculation of the data packet at the processing node to create a processed data packet, attaching a tag to the processed data packet, transmitting the processed data packet from the processing node to a receiving node during a systolic pulse, receiving the processed data packet at the receiving node, performing a clockwise convolution on the processed data packet and a counter clockwise convolution on the processed data packet, performing an adding function and backpropagating results of the performed sigmoid function to each of the processing nodes that originally processed the data packet.

    PRE-TRAINING NEURAL NETWORKS WITH HUMAN DEMONSTRATIONS FOR DEEP REINFORCEMENT LEARNING

    公开(公告)号:US20190236455A1

    公开(公告)日:2019-08-01

    申请号:US16264625

    申请日:2019-01-31

    IPC分类号: G06N3/08 G06N3/04 G06K9/62

    摘要: Disclosed herein are a system and method for providing a machine learning architecture based on monitored demonstrations. The system may include: a non-transitory computer-readable memory storage; at least one processor configured for dynamically training a machine learning architecture for performing one or more sequential tasks, the at least one processor configured to provide: a data receiver for receiving one or more demonstrator data sets, each demonstrator data set including a data structure representing the one or more state-action pairs; a neural network of the machine learning architecture, the neural network including a group of nodes in one or more layers; and a pre-training engine configured for processing the one or more demonstrator data sets to extract one or more features, the extracted one or more features used to pre-train the neural network based on the one or more state-action pairs observed in one or more interactions with the environment.

    UNSUPERVISED MODEL BUILDING FOR CLUSTERING AND ANOMALY DETECTION

    公开(公告)号:US20190228312A1

    公开(公告)日:2019-07-25

    申请号:US15880339

    申请日:2018-01-25

    摘要: During training mode, first input data is provided to a first neural network to generate first output data indicating that the first input data is classified in a first cluster. The first input data includes at least one of a continuous feature or a categorical feature. Second input data is generated and provided to at least one second neural network to generate second output data. The at least one second neural network corresponds to a variational autoencoder. An aggregate loss corresponding to the second output data is determined, including at least one of evaluating a first loss function for the continuous feature or evaluating a second loss function for the categorical feature. Based on the aggregate loss, at least one parameter of at least one neural network is adjusted. During use mode, the neural networks are used to determine cluster identifications and anomaly likelihoods for received data samples.