Feature computation in a sensor element array

    公开(公告)号:US09838635B2

    公开(公告)日:2017-12-05

    申请号:US14862319

    申请日:2015-09-23

    Abstract: Techniques describe computing computer vision (CV) features based on sensor readings from a sensor and detecting macro-features based on the CV features. The sensor may include a sensor element array that includes a plurality of sensor elements. The sensor may also include in-pixel circuitry coupled to the sensor elements, peripheral circuitry and/or a dedicated microprocessor coupled to the sensor element array. The in-pixel circuitry, the peripheral circuitry or the dedicated microprocessor may include computation structures configured to perform analog or digital operations representative of a multi-pixel computation for a sensor element (or block of sensor elements), based on sensor readings generated by neighboring sensor elements in proximity to the sensor element, and to generate CV features. The dedicated microprocessor may process the CV features and detect macro-features. Furthermore, in certain embodiments, the dedicated microprocessor may be coupled to a second microprocessor through a wired or wireless interface.

    COMPUTING HIERARCHICAL COMPUTATIONS FOR COMPUTER VISION CALCULATIONS
    24.
    发明申请
    COMPUTING HIERARCHICAL COMPUTATIONS FOR COMPUTER VISION CALCULATIONS 有权
    计算机视觉计算的计算分层计算

    公开(公告)号:US20160292530A1

    公开(公告)日:2016-10-06

    申请号:US14861968

    申请日:2015-09-22

    Inventor: Alok Govil

    Abstract: Methods, systems, computer-readable storage media, and apparatuses for efficiently computing a computer vision operation are presented. In certain aspects, techniques are disclosed for receiving values from one or more pixels from a pixel array and representing those values for facilitating computer vision operations, such as Haar-like feature computations. In one implementation, the pixel values are represented as a hierarchy of computations; each level above the lower level of the hierarchy of computations comprises one or more values representing a computation of the values from a lower level of the hierarchy. The computation can include a simple sum of the values for the lower level of the hierarchy, a weighted sum of the values for the lower level of the hierarchy, an average of the values for the lower level of the hierarchy, a local binary pattern based on the values for the lower level of the hierarchy, a histogram of oriented gradients based on the values for the lower level of the hierarchy, or other computer vision feature computation based on the values for the lower level of the hierarchy. In such an implementation, the computer vision operations, such as Haar-like feature computations, may be performed using the hierarchy of averages.

    Abstract translation: 提出了用于有效计算计算机视觉操作的方法,系统,计算机可读存储介质和装置。 在某些方面,公开了用于从像素阵列接收来自一个或多个像素的值并且表示用于促进计算机视觉操作的那些值的技术,例如哈尔状特征计算。 在一个实现中,像素值被表示为计算层级; 在计算层级的较低级别之上的每个级别包括一个或多个表示来自层级的较低级别的值的计算的值。 该计算可以包括层次的较低级别的值的简单和,层级的较低级别的值的加权和,层级的较低级别的值的平均值,基于局部二进制模式 关于层级较低级别的值,基于层级较低级别的值的定向梯度的直方图或基于层级较低级别的值的其他计算机视觉特征计算。 在这种实现中,可以使用平均层次来执行计算机视觉操作,例如哈尔状特征计算。

    Configurable hardware for computing computer vision features

    公开(公告)号:US09762834B2

    公开(公告)日:2017-09-12

    申请号:US14859533

    申请日:2015-09-21

    CPC classification number: H04N5/3745 G06K9/605 H04N5/23229

    Abstract: Techniques describe apparatus and method for generating computed results based on sensor readings for detecting features, such as edges, corners etc. The sensor apparatus may include a sensor element array that includes a plurality of sensor elements. The sensor elements may be arranged in a 2-dimensional array, such as columns and rows. The sensor elements may be capable of generating sensor reading based on environmental conditions. The sensor apparatus may include a dedicated computer vision (CV) computation hardware in in-pixel circuitry, peripheral circuitry or dedicated microprocessor coupled to the sensor element array and configured to receive output from one or more of sensor elements. The dedicated CV computation hardware may include configurable blocks for detecting features using CV operations, wherein the configurable blocks may be configured to switch between multiple CV operations, such as linear binary pattern (LBP) and/or histogram of signed gradient (HSG) computer vision operations.

    Low-power always-on face detection, tracking, recognition and/or analysis using events-based vision sensor
    30.
    发明授权
    Low-power always-on face detection, tracking, recognition and/or analysis using events-based vision sensor 有权
    使用基于事件的视觉传感器进行低功耗持续面部检测,跟踪,识别和/或分析

    公开(公告)号:US09554100B2

    公开(公告)日:2017-01-24

    申请号:US14866549

    申请日:2015-09-25

    Abstract: Techniques disclosed herein utilize a vision sensor that integrates a special-purpose camera with dedicated computer vision (CV) computation hardware and a dedicated low-power microprocessor for the purposes of detecting, tracking, recognizing, and/or analyzing subjects, objects, and scenes in the view of the camera. The vision sensor processes the information retrieved from the camera using the included low-power microprocessor and sends “events” (or indications that one or more reference occurrences have occurred, and, possibly, associated data) for the main processor only when needed or as defined and configured by the application. This allows the general-purpose microprocessor (which is typically relatively high-speed and high-power to support a variety of applications) to stay in a low-power (e.g., sleep mode) most of the time as conventional, while becoming active only when events are received from the vision sensor.

    Abstract translation: 本文公开的技术利用视觉传感器,其将特殊用途相机与专用计算机视觉(CV)计算硬件和专用低功率微处理器集成,用于检测,跟踪,识别和/或分析主体,对象和场景 在相机的视野。 视觉传感器使用附带的低功率微处理器处理从摄像机检索的信息,并且仅在需要时发送主处理器的“事件”(或发生了一个或多个参考事件以及可能的关联数据),或者作为 由应用程序定义和配置。 这允许通用微处理器(通常是相对高速和大功率来支持各种应用程序)在大多数时间内保持在低功率(例如,睡眠模式)中,同时仅成为活动的 当从视觉传感器接收到事件时。

Patent Agency Ranking