-
11.
公开(公告)号:US20190303747A1
公开(公告)日:2019-10-03
申请号:US15937357
申请日:2018-03-27
IPC分类号: G06N3/063
摘要: Distributed state via cascades of tensor decompositions and neuron activation binding on neuromorphic hardware is provided. In various embodiments, a kernel is divided into a plurality of subkernels. Each subkernel has less than a predetermined size. The plurality of subkernels are distributed, each to one of a plurality of neurosynaptic processors. By each of the plurality of neurosynaptic processors, one of the subkernels is applied to an input to generate a partial convolution. The partial convolutions from each of the plurality of neurosynaptic processors are combined to determine an activation.
-
公开(公告)号:US10169844B2
公开(公告)日:2019-01-01
申请号:US15967362
申请日:2018-04-30
摘要: One or more embodiments provide a neurosynaptic circuit that includes multiple neurosynaptic core circuits that: perform image distortion correction by converting a source image to a destination image by: taking as input a sequence of image frames of a video with one or more channels per frame, and converting dimensions and pixel distortion coefficients of each frame as one or more corresponding neuronal firing events. Each distorted pixel is mapped to zero or more undistorted pixels by processing each neuronal firing event corresponding to each pixel of each image frame. Corresponding pixel intensity values of each distorted pixel are processed to output undistorted pixels for each image frame as neuronal firing events for a spike representation of the destination image.
-
公开(公告)号:US10140551B2
公开(公告)日:2018-11-27
申请号:US15993482
申请日:2018-05-30
发明人: Alexander Andreopoulos , Rathinakumar Appuswamy , Pallab Datta , Steven K. Esser , Dharmendra S. Modha
IPC分类号: G06K9/62 , G06K9/52 , G06K9/46 , H04N19/136 , G06N3/063 , H04N9/67 , G06K9/00 , G06K9/66 , G06N3/08 , G06T7/246
摘要: Embodiments of the invention provide a method for scene understanding based on a sequence of image frames. The method comprises converting each pixel of each image frame to neural spikes, and extracting features from the sequence of image frames by processing neural spikes corresponding to pixels of the sequence of image frames. The method further comprises encoding the extracted features as neural spikes, and classifying the extracted features.
-
公开(公告)号:US20180276502A1
公开(公告)日:2018-09-27
申请号:US15993482
申请日:2018-05-30
发明人: Alexander Andreopoulos , Rathinakumar Appuswamy , Pallab Datta , Steven K. Esser , Dharmendra S. Modha
IPC分类号: G06K9/62 , H04N9/67 , G06K9/46 , G06T7/246 , G06N3/08 , G06N3/063 , G06K9/66 , G06K9/52 , H04N19/136 , G06K9/00
CPC分类号: G06K9/6256 , G06K9/00718 , G06K9/00986 , G06K9/46 , G06K9/4623 , G06K9/4652 , G06K9/4661 , G06K9/4671 , G06K9/4676 , G06K9/52 , G06K9/6267 , G06K9/66 , G06N3/0635 , G06N3/08 , G06T7/246 , G06T2207/10016 , G06T2207/20081 , H04N9/67 , H04N19/136
摘要: Embodiments of the invention provide a method for scene understanding based on a sequence of image frames. The method comprises converting each pixel of each image frame to neural spikes, and extracting features from the sequence of image frames by processing neural spikes corresponding to pixels of the sequence of image frames. The method further comprises encoding the extracted features as neural spikes, and classifying the extracted features.
-
公开(公告)号:US09922266B2
公开(公告)日:2018-03-20
申请号:US15087945
申请日:2016-03-31
CPC分类号: G06K9/4671 , G06K9/00744 , G06K9/4604 , G06K9/4652 , G06K9/4676 , G06K9/66 , G06N3/049 , G06N3/063
摘要: Embodiments of the invention provide a method of visual saliency estimation comprising receiving an input sequence of image frames. Each image frame has one or more channels, and each channel has one or more pixels. The method further comprises, for each channel of each image frame, generating corresponding neural spiking data based on a pixel intensity of each pixel of the channel, generating a corresponding multi-scale data structure based on the corresponding neural spiking data, and extracting a corresponding map of features from the corresponding multi-scale data structure. The multi-scale data structure comprises one or more data layers, wherein each data layer represents a spike representation of pixel intensities of a channel at a corresponding scale. The method further comprises encoding each map of features extracted as neural spikes.
-
公开(公告)号:US20180018756A1
公开(公告)日:2018-01-18
申请号:US15495487
申请日:2017-04-24
CPC分类号: G06T3/4046 , G06F17/11 , G06K9/4604 , G06K9/66 , G06N3/063 , G06T1/20 , G06T5/006 , G06T2207/20084 , G06T2207/20172
摘要: One or more embodiments provide a neurosynaptic circuit that includes multiple neurosynaptic core circuits that: perform image sharpening by converting a source image to a sharpened destination image by: taking as input a sequence of image frames of a video with one or more channels per frame, and representing the intensity of each pixel of each channel of each frame as neural spikes; processing the source image to obtain the sharpened destination image for a particular frame and channel that enhances certain high frequency components of the source image; and processing neural spike representations of the destination image for outputting a spike representation of the sharpened destination image.
-
公开(公告)号:US20160232430A1
公开(公告)日:2016-08-11
申请号:US15133102
申请日:2016-04-19
发明人: Alexander Andreopoulos , Rathinakumar Appuswamy , Pallab Datta , Steven K. Esser , Dharmendra S. Modha
CPC分类号: G06K9/6256 , G06K9/00718 , G06K9/00986 , G06K9/46 , G06K9/4623 , G06K9/4652 , G06K9/4661 , G06K9/4671 , G06K9/4676 , G06K9/52 , G06K9/6267 , G06K9/66 , G06N3/0635 , G06N3/08 , G06T7/246 , G06T2207/10016 , G06T2207/20081 , H04N9/67 , H04N19/136
摘要: Embodiments of the invention provide a method for scene understanding based on a sequence of image frames. The method comprises converting each pixel of each image frame to neural spikes, and extracting features from the sequence of image frames by processing neural spikes corresponding to pixels of the sequence of image frames. The method further comprises encoding the extracted features as neural spikes, and classifying the extracted features.
-
公开(公告)号:US11361214B2
公开(公告)日:2022-06-14
申请号:US15406211
申请日:2017-01-13
摘要: Dynamic multiscale routing on networks of neurosynaptic cores with a feedback attention beam and short term memory with inhibition of return is provided. In various embodiments, an input topographic map is received at a spiking neuromorphic hardware system. A saliency map is received, associating a saliency value with each of a plurality of regions of the input topographic map. Based on the saliency map, a first of the plurality of regions in order of saliency value is routed. The first of the plurality of regions is suppressed. Based on the saliency map, a predetermined number of the plurality of regions are sequentially routed in order of saliency value.
-
公开(公告)号:US11120561B2
公开(公告)日:2021-09-14
申请号:US16177011
申请日:2018-10-31
摘要: Detection, tracking and recognition on networks of digital neurosynaptic cores are provided. In various embodiments, an image sensor is configured to provide a time-series of frames. A first artificial neural network is operatively coupled to the image sensor and configured to detect a plurality of objects in the time-series of frames. A second artificial neural network is operatively coupled to the first artificial neural network and configured to classify objects detected by the first neural network and output a location and classification of said classified objects. The first and second artificial neural networks comprise one or more spike-based neurosynaptic cores.
-
公开(公告)号:US10528843B2
公开(公告)日:2020-01-07
申请号:US15855820
申请日:2017-12-27
摘要: Embodiments of the invention provide a method of visual saliency estimation comprising receiving an input video of image frames. Each image frame has one or more channels, and each channel has one or more pixels. The method further comprises, for each channel of each image frame, generating corresponding neural spiking data based on a pixel intensity of each pixel of the channel, generating a corresponding multi-scale data structure based on the corresponding neural spiking data, and extracting a corresponding map of features from the corresponding multi-scale data structure. The multi-scale data structure comprises one or more data layers, wherein each data layer represents a spike representation of pixel intensities of a channel at a corresponding scale. The method further comprises encoding each map of features extracted as neural spikes.
-
-
-
-
-
-
-
-
-