Neuromorphic system for real-time visual activity recognition

    公开(公告)号:US10997421B2

    公开(公告)日:2021-05-04

    申请号:US15947032

    申请日:2018-04-06

    Abstract: Described is a system for visual activity recognition that includes one or more processors and a memory, the memory being a non-transitory computer-readable medium having executable instructions encoded thereon, such that upon execution of the instructions, the one or more processors perform operations including detecting a set of objects of interest in video data and determining an object classification for each object in the set of objects of interest, the set including at least one object of interest. The one or more processors further perform operations including forming a corresponding activity track for each object in the set of objects of interest by tracking each object across frames. The one or more processors further perform operations including, for each object of interest and using a feature extractor, determining a corresponding feature in the video data. The system may provide a report to a user's cell phone or central monitoring facility.

    SYSTEM FOR REAL-TIME OBJECT DETECTION AND RECOGNITION USING BOTH IMAGE AND SIZE FEATURES

    公开(公告)号:US20190180119A1

    公开(公告)日:2019-06-13

    申请号:US16276513

    申请日:2019-02-14

    Abstract: Described is an object recognition system. Using an integral channel features (ICF) detector, the system extracts a candidate target region (having an associated original confidence score representing a candidate object) from an input image of a scene surrounding a platform. A modified confidence score is generated based on a location and height of detection of the candidate object. The candidate target regions are classified based on the modified confidence score using a trained convolutional neural network (CNN) classifier, resulting in classified objects. The classified objects are tracked using a multi-target tracker for final classification of each classified object as a target or non-target. If the classified object is a target, a device can be controlled based on the target.

    System and method for performing real-time video object recognition utilizing convolutional neural networks

    公开(公告)号:US10289910B1

    公开(公告)日:2019-05-14

    申请号:US15399522

    申请日:2017-01-05

    Abstract: Described is a system for real-time object recognition. During operation, the system extracts convolutional neural network (CNN) feature vectors from an input image. The input image reflects a scene proximate the system, with the feature vector representing an object in the input image. The CNN feature vector is matched against feature vectors stored in a feature dictionary to identify k nearest neighbors for each object class stored in the feature dictionary. The matching results in a probability distribution over object classes stored in the feature dictionary. The probability distribution provides a confidence score that each of the object classes in the feature dictionary are representative of the object in the input image. Based on the confidence scores, the object in the input image is then recognized as being a particular object class when the confidence score for the particular object class exceeds a threshold.

    NEUROMORPHIC SYSTEM FOR REAL-TIME VISUAL ACTIVITY RECOGNITION

    公开(公告)号:US20180300553A1

    公开(公告)日:2018-10-18

    申请号:US15947032

    申请日:2018-04-06

    Abstract: Described is a system for visual activity recognition that includes one or more processors and a memory, the memory being a non-transitory computer-readable medium having executable instructions encoded thereon, such that upon execution of the instructions, the one or more processors perform operations including detecting a set of objects of interest in video data and determining an object classification for each object in the set of objects of interest, the set including at least one object of interest. The one or more processors further perform operations including forming a corresponding activity track for each object in the set of objects of interest by tracking each object across frames. The one or more processors further perform operations including, for each object of interest and using a feature extractor, determining a corresponding feature in the video data. The system may provide a report to a user's cell phone or central monitoring facility.

    Object recognition consistency improvement using a pseudo-tracklet approach
    9.
    发明授权
    Object recognition consistency improvement using a pseudo-tracklet approach 有权
    使用伪轨迹方法的对象识别一致性改进

    公开(公告)号:US09342759B1

    公开(公告)日:2016-05-17

    申请号:US14204384

    申请日:2014-03-11

    Abstract: Described is a system for improving object recognition. Object detection results and classification results for a sequence of image frames are received as input. Each object detection result is represented by a detection box and each classification result is represented by an object label corresponding to the object detection result. A pseudo-tracklet is formed by linking object detection results representing the same object in consecutive image frames. The system determines whether there are any inconsistent object labels or missing object detection results in the pseudo-tracklet. Finally, the object detection results and the classification results are improved by correcting any inconsistent object labels and missing object detection results.

    Abstract translation: 描述了一种改善对象识别的系统。 接收作为输入的图像帧序列的对象检测结果和分类结果。 每个对象检测结果由检测框表示,并且每个分类结果由与对象检测结果对应的对象标签表示。 通过将表示相同对象的对象检测结果链接在连续图像帧中来形成伪轨迹。 系统确定伪踪迹中是否存在任何不一致的对象标签或丢失的对象检测结果。 最后,通过校正任何不一致的对象标签和缺少的对象检测结果来改进对象检测结果和分类结果。

    Selective color processing for vision systems that enables optimal detection and recognition
    10.
    发明授权
    Selective color processing for vision systems that enables optimal detection and recognition 有权
    视觉系统的选择性颜色处理,可实现最佳的检测和识别

    公开(公告)号:US09111355B1

    公开(公告)日:2015-08-18

    申请号:US14205327

    申请日:2014-03-11

    CPC classification number: G06T5/008 G06T2207/10024

    Abstract: Described is a system for selective color processing for vision systems. The system receives a multi-band image as input. As an optional step, the multi-band image is preprocessed, and a transformation is performed to transform the multi-band image into a color space. A metric function is applied to the transformed image to generate a distance map comprising intensities which vary based on a similarity between an intensity of a pixel color and an intensity of a target color. A contrast enhancement process is applied to the distance map to normalize the distance map to a range of values. The range of values is expanded near the intensity of the target color. Finally, an output response map for the target color of interest is generated, such that the output response map has high responses in regions which are similar to the target color to aid in detection and recognition processes.

    Abstract translation: 描述了用于视觉系统的选择性颜色处理的系统。 系统接收多频带​​图像作为输入。 作为可选步骤,对多频带图像进行预处理,并且进行变换以将多频带图像变换为颜色空间。 度量函数被应用于变换图像以产生距离图,其包括基于像素颜色的强度和目标颜色的强度之间的相似度而变化的强度。 将对比度增强过程应用于距离图,以将距离图归一化为一定范围的值。 值的范围在目标颜色的强度附近扩展。 最后,生成目标感兴趣的颜色的输出响应图,使得输出响应图在与目标颜色相似的区域中具有高响应,以帮助检测和识别过程。

Patent Agency Ranking