Lens distortion correction using a neurosynaptic circuit

    公开(公告)号:US10169844B2

    公开(公告)日:2019-01-01

    申请号:US15967362

    申请日:2018-04-30

    摘要: One or more embodiments provide a neurosynaptic circuit that includes multiple neurosynaptic core circuits that: perform image distortion correction by converting a source image to a destination image by: taking as input a sequence of image frames of a video with one or more channels per frame, and converting dimensions and pixel distortion coefficients of each frame as one or more corresponding neuronal firing events. Each distorted pixel is mapped to zero or more undistorted pixels by processing each neuronal firing event corresponding to each pixel of each image frame. Corresponding pixel intensity values of each distorted pixel are processed to output undistorted pixels for each image frame as neuronal firing events for a spike representation of the destination image.

    Dynamic multiscale routing on networks of neurosynaptic cores

    公开(公告)号:US11361214B2

    公开(公告)日:2022-06-14

    申请号:US15406211

    申请日:2017-01-13

    IPC分类号: G06N3/04 G06N3/063

    摘要: Dynamic multiscale routing on networks of neurosynaptic cores with a feedback attention beam and short term memory with inhibition of return is provided. In various embodiments, an input topographic map is received at a spiking neuromorphic hardware system. A saliency map is received, associating a saliency value with each of a plurality of regions of the input topographic map. Based on the saliency map, a first of the plurality of regions in order of saliency value is routed. The first of the plurality of regions is suppressed. Based on the saliency map, a predetermined number of the plurality of regions are sequentially routed in order of saliency value.

    Detection, tracking and recognition on networks of digital neurosynaptic cores

    公开(公告)号:US11120561B2

    公开(公告)日:2021-09-14

    申请号:US16177011

    申请日:2018-10-31

    IPC分类号: G06T7/246 G06N3/04 G06K9/62

    摘要: Detection, tracking and recognition on networks of digital neurosynaptic cores are provided. In various embodiments, an image sensor is configured to provide a time-series of frames. A first artificial neural network is operatively coupled to the image sensor and configured to detect a plurality of objects in the time-series of frames. A second artificial neural network is operatively coupled to the first artificial neural network and configured to classify objects detected by the first neural network and output a location and classification of said classified objects. The first and second artificial neural networks comprise one or more spike-based neurosynaptic cores.

    Extracting motion saliency features from video using a neurosynaptic system

    公开(公告)号:US10528843B2

    公开(公告)日:2020-01-07

    申请号:US15855820

    申请日:2017-12-27

    摘要: Embodiments of the invention provide a method of visual saliency estimation comprising receiving an input video of image frames. Each image frame has one or more channels, and each channel has one or more pixels. The method further comprises, for each channel of each image frame, generating corresponding neural spiking data based on a pixel intensity of each pixel of the channel, generating a corresponding multi-scale data structure based on the corresponding neural spiking data, and extracting a corresponding map of features from the corresponding multi-scale data structure. The multi-scale data structure comprises one or more data layers, wherein each data layer represents a spike representation of pixel intensities of a channel at a corresponding scale. The method further comprises encoding each map of features extracted as neural spikes.