-
公开(公告)号:US20220129436A1
公开(公告)日:2022-04-28
申请号:US17077759
申请日:2020-10-22
发明人: Alexander Andreopoulos , Dharmendra S. Modha , Andrew Stephen Cassidy , Brian Seisho Taba , Carmelo Di Nolfo , Hartmut Penner , John Vernon Arthur , Jun Sawada , Myron D. Flickner , Pallab Datta , Rathinakumar Appuswamy
摘要: Systems are provided that can produce symbolic and numeric representations of the neural network outputs, such that these outputs can be used to validate correctness of the implementation of the neural network. In various embodiments, a description of an artificial neural network containing no data-dependent branching is read. Based on the description of the artificial neural network, a symbolic representation is constructed of an output of the artificial neural network, the symbolic representation comprising at least one variable. The symbolic representation is compared to a ground truth symbolic representation, thereby validating the neural network system.
-
公开(公告)号:US11238347B2
公开(公告)日:2022-02-01
申请号:US16146632
申请日:2018-09-28
发明人: Brian Taba , Andrew S. Cassidy , Myron D. Flickner , Pallab Datta , Hartmut Penner , Rathinakumar Appuswamy , Jun Sawada , John V. Arthur , Dharmendra S. Modha , Steven K. Esser , Jennifer Klamo
摘要: Parallel processing among arrays of physical neural cores is provided. An array of neural cores is adapted to compute, in parallel, an output activation tensor of a neural network layer. A network is operatively connected to each of the neural cores. The output activation tensor is distributed across the neural cores. An input activation tensor is distributed across the neural cores. A weight tensor is distributed across the neural cores. Each neural core's computation comprises multiplying elements of a portion of the input activation tensor at that core with elements of a portion of the weight tensor at that core, and storing the summed products in a partial sum corresponding to an element of the output activation tensor. Each element of the output activation tensor is computed by accumulating all of the partial sums corresponding to that element via the network. The partial sums for each element of the output activation tensor are computed in a sequence of steps whose order is described by tracing a path through the weight tensor that visits every weight tensor element that contributes to any partial sum.
-
公开(公告)号:US20210209450A1
公开(公告)日:2021-07-08
申请号:US16733393
申请日:2020-01-03
发明人: Andrew S. Cassidy , Rathinakumar Appuswamy , John V. Arthur , Pallab Datta , Steve Esser , Myron D. Flickner , Dharmendra S. Modha , Jun Sawada
IPC分类号: G06N3/063
摘要: A neural inference chip includes a global weight memory; a neural core; and a network connecting the global weight memory to the at least one neural core. The neural core comprises a local weight memory. The local weight memory comprises a plurality of memory banks. Each of the plurality of memory banks is uniquely addressable by at least one index. The neural inference chip is adapted to store in the global weight memory a compressed weight block comprising at least one compressed weight matrix. The neural inference chip is adapted to transmit the compressed weight block from the global weight memory to the core via the network. The core is adapted to decode the at least one compressed weight matrix into a decoded weight matrix and store the decoded weight matrix in its local weight memory. The at core is adapted to apply the decoded weight matrix to a plurality of input activations to produce a plurality of output activations.
-
公开(公告)号:US11010662B2
公开(公告)日:2021-05-18
申请号:US16808900
申请日:2020-03-04
发明人: Rathinakumar Appuswamy , John V. Arthur , Andrew S. Cassidy , Pallab Datta , Steven K. Esser , Myron D. Flickner , Jennifer Klamo , Dharmendra S. Modha , Hartmut Penner , Jun Sawada , Brian Taba
摘要: Massively parallel neural inference computing elements are provided. A plurality of multipliers is arranged in a plurality of equal-sized groups. Each of the plurality of multipliers is adapted to, in parallel, apply a weight to an input activation to generate an output. A plurality of adders is operatively coupled to one of the groups of multipliers. Each of the plurality of adders is adapted to, in parallel, add the outputs of the multipliers within its associated group to generate a partial sum. A plurality of function blocks is operatively coupled to one of the plurality of adders. Each of the plurality of function blocks is adapted to, in parallel, apply a function to the partial sum of its associated adder to generate an output value.
-
公开(公告)号:US10650301B2
公开(公告)日:2020-05-12
申请号:US14273487
申请日:2014-05-08
发明人: Rodrigo Alvarez-Icaza Rivera , Rathinakumar Appuswamy , John V. Arthur , Andrew S. Cassidy , Bryan L. Jackson , Paul A. Merolla , Dharmendra S. Modha , Jun Sawada
摘要: Embodiments of the invention provide a neurosynaptic system comprising a delay unit for receiving and buffering axonal inputs, and a neural computation unit for generating neuronal outputs by performing a set of computations based on at least one axonal input received by the delay unit. The system further comprises a permutation unit for receiving external inputs to the system, and transmitting external outputs from the system. The permutation unit maps each external input received as either an axonal input to the delay unit or an external output from the system. The permutation unit maps each neuronal output generated by the neural computation unit as either an axonal input to the delay unit or an external output from the system. The neural computation unit comprises multiple electronic neurons, multiple electronic axons, and a plurality of electronic synapse devices interconnecting the neurons with the axons.
-
公开(公告)号:US20190138883A1
公开(公告)日:2019-05-09
申请号:US15980612
申请日:2018-05-15
摘要: Embodiments of the present invention provide a method for feature extraction comprising generating synaptic connectivity information for a neurosynaptic core circuit. The core circuit comprises one or more electronic neurons, one or more electronic axons, and an interconnect fabric including a plurality of synapse devices for interconnecting the neurons with the axons. The method further comprises initializing the interconnect fabric based on the synaptic connectivity information generated, and extracting a set of features from input received via the electronic axons. The set of features extracted comprises a set of features with reduced correlation.
-
公开(公告)号:US10198690B2
公开(公告)日:2019-02-05
申请号:US15184917
申请日:2016-06-16
摘要: Embodiments of the present invention provide a method for feature extraction using multiple neurosynaptic core circuits including one or more input core circuits for receiving input and one or more output core circuits for generating output. The method comprises receiving a set of input data via the input core circuits, and extracting a first set of features from the input data using the input core circuits. Each feature of the first set of features is based on a subset of the input data. The method further comprises reordering the first set of features using the input core circuits, and generating a second set of features by combining the reordered first set of features using the output core circuits. The second set of features comprises a set of features with reduced correlation. Each feature of the second set of features is based on the entirety of said set of input data.
-
公开(公告)号:US20180232631A1
公开(公告)日:2018-08-16
申请号:US15434672
申请日:2017-02-16
CPC分类号: G06N3/049 , G06F13/1689 , G06F13/4068 , G06N3/0445 , G06N3/063
摘要: Long-short term memory (LSTM) cells on spiking neuromorphic hardware are provided. In various embodiments, such systems comprise a spiking neurosynaptic core. The neurosynaptic core comprises a memory cell, an input gate operatively coupled to the memory cell and adapted to selectively admit an input to the memory cell, and an output gate operatively coupled to the memory cell an adapted to selectively release an output from the memory cell. The memory cell is adapted to maintain a value in the absence of input.
-
公开(公告)号:US20170068884A1
公开(公告)日:2017-03-09
申请号:US15184880
申请日:2016-06-16
摘要: Embodiments of the present invention provide a method for feature extraction comprising generating synaptic connectivity information for a neurosynaptic core circuit. The core circuit comprises one or more electronic neurons, one or more electronic axons, and an interconnect fabric including a plurality of synapse devices for interconnecting the neurons with the axons. The method further comprises initializing the interconnect fabric based on the synaptic connectivity information generated, and extracting a set of features from input received via the electronic axons. The set of features extracted comprises a set of features with reduced correlation.
摘要翻译: 本发明的实施例提供了一种用于特征提取的方法,包括产生用于神经突触核心电路的突触连接信息。 核心电路包括一个或多个电子神经元,一个或多个电子轴突,以及包括用于将神经元与轴突互连的多个突触装置的互连结构。 该方法还包括基于产生的突触连接信息来初始化互连结构,以及经由电子轴突接收的输入提取一组特征。 所提取的特征集包括具有降低的相关性的一组特征。
-
公开(公告)号:US20170039429A1
公开(公告)日:2017-02-09
申请号:US15298137
申请日:2016-10-19
发明人: Alexander Andreopoulos , Rathinakumar Appuswamy , Pallab Datta , Steven K. Esser , Dharmendra S. Modha
CPC分类号: G06K9/6256 , G06K9/00718 , G06K9/00986 , G06K9/46 , G06K9/4623 , G06K9/4652 , G06K9/4661 , G06K9/4671 , G06K9/4676 , G06K9/52 , G06K9/6267 , G06K9/66 , G06N3/0635 , G06N3/08 , G06T7/246 , G06T2207/10016 , G06T2207/20081 , H04N9/67 , H04N19/136
摘要: Embodiments of the invention provide a method for scene understanding based on a sequence of image frames. The method comprises converting each pixel of each image frame to neural spikes, and extracting features from the sequence of image frames by processing neural spikes corresponding to pixels of the sequence of image frames. The method further comprises encoding the extracted features as neural spikes, and classifying the extracted features.
摘要翻译: 本发明的实施例提供了一种基于图像帧序列的场景理解的方法。 该方法包括将每个图像帧的每个像素转换为神经尖峰,以及通过处理对应于图像帧序列的像素的神经尖峰从图像帧序列中提取特征。 该方法还包括将提取的特征编码为神经尖峰,并对所提取的特征进行分类。
-
-
-
-
-
-
-
-
-