FEATURE COMPUTATION IN A SENSOR ELEMENT ARRAY
    11.
    发明申请
    FEATURE COMPUTATION IN A SENSOR ELEMENT ARRAY 有权
    传感器元件阵列中的特征计算

    公开(公告)号:US20160094800A1

    公开(公告)日:2016-03-31

    申请号:US14862319

    申请日:2015-09-23

    Abstract: Techniques describe computing computer vision (CV) features based on sensor readings from a sensor and detecting macro-features based on the CV features. The sensor may include a sensor element array that includes a plurality of sensor elements. The sensor may also include in-pixel circuitry coupled to the sensor elements, peripheral circuitry and/or a dedicated microprocessor coupled to the sensor element array. The in-pixel circuitry, the peripheral circuitry or the dedicated microprocessor may include computation structures configured to perform analog or digital operations representative of a multi-pixel computation for a sensor element (or block of sensor elements), based on sensor readings generated by neighboring sensor elements in proximity to the sensor element, and to generate CV features. The dedicated microprocessor may process the CV features and detect macro-features. Furthermore, in certain embodiments, the dedicated microprocessor may be coupled to a second microprocessor through a wired or wireless interface.

    Abstract translation: 技术描述了基于传感器的传感器读数计算计算机视觉(CV)特征,并基于CV特征检测宏特征。 传感器可以包括包括多个传感器元件的传感器元件阵列。 传感器还可以包括耦合到传感器元件,外围电路和/或耦合到传感器元件阵列的专用微处理器的像素内电路。 像素内电路,外围电路或专用微处理器可以包括计算结构,其被配置为基于相邻的传感器读数来执行表示传感器元件(或传感器元件的块)的多像素计算的模拟或数字操作 传感器元件靠近传感器元件,并产生CV特征。 专用微处理器可以处理CV特征并检测宏特征。 此外,在某些实施例中,专用微处理器可以通过有线或无线接口耦合到第二微处理器。

    EVENT BASED COMPUTER VISION COMPUTATION
    12.
    发明申请
    EVENT BASED COMPUTER VISION COMPUTATION 审中-公开
    基于事件的计算机视觉计算

    公开(公告)号:US20160094787A1

    公开(公告)日:2016-03-31

    申请号:US14859146

    申请日:2015-09-18

    Abstract: Certain techniques are provided for triggering events based on detecting changes in CV features, such as edges, corners etc., by generating computed results based on sensor readings. Yet other techniques also provided for detecting CV features once an event is detecting based on a change in a sensor reading for a sensor element. In certain aspects, the event detection logic and the feature calculation CV vision operations may be performed, individually, or in combination in circuitry on a sensor or in software/firmware on a computing device.

    Abstract translation: 通过基于传感器读数产生计算结果,提供了一些基于检测CV特征(例如边缘,拐角等)的变化来触发事件的技术。 还有一些技术还提供了一旦基于传感器元件的传感器读数的改变来检测事件,则检测CV特征。 在某些方面,事件检测逻辑和特征计算CV视觉操作可以单独地或组合地在传感器上的电路中或在计算设备上的软件/固件中执行。

    CONFIGURABLE HARDWARE FOR COMPUTING COMPUTER VISION FEATURES
    13.
    发明申请
    CONFIGURABLE HARDWARE FOR COMPUTING COMPUTER VISION FEATURES 有权
    用于计算机视觉功能的可配置硬件

    公开(公告)号:US20160091946A1

    公开(公告)日:2016-03-31

    申请号:US14859533

    申请日:2015-09-21

    CPC classification number: H04N5/3745 G06K9/605 H04N5/23229

    Abstract: Techniques describe apparatus and method for generating computed results based on sensor readings for detecting features, such as edges, corners etc. The sensor apparatus may include a sensor element array that includes a plurality of sensor elements. The sensor elements may be arranged in a 2-dimensional array, such as columns and rows. The sensor elements may be capable of generating sensor reading based on environmental conditions. The sensor apparatus may include a dedicated computer vision (CV) computation hardware in in-pixel circuitry, peripheral circuitry or dedicated microprocessor coupled to the sensor element array and configured to receive output from one or more of sensor elements. The dedicated CV computation hardware may include configurable blocks for detecting features using CV operations, wherein the configurable blocks may be configured to switch between multiple CV operations, such as linear binary pattern (LBP) and/or histogram of signed gradient (HSG) computer vision operations.

    Abstract translation: 技术描述了用于基于用于检测诸如边缘,拐角等的特征的传感器读数产生计算结果的装置和方法。传感器装置可以包括包括多个传感器元件的传感器元件阵列。 传感器元件可以被布置在诸如列和行的二维阵列中。 传感器元件可以基于环境条件产生传感器读数。 传感器装置可以包括像素电路中的专用计算机视觉(CV)计算硬件,耦合到传感器元件阵列的外围电路或专用微处理器,并被配置为从一个或多个传感器元件接收输出。 专用CV计算硬件可以包括用于使用CV操作检测特征的可配置块,其中可配置块可以被配置为在诸如线性二进制模式(LBP)和/或带符号梯度(HSG)计算机视觉的直方图的多个CV操作之间切换 操作。

    Computing hierarchical computations for computer vision calculations

    公开(公告)号:US09704056B2

    公开(公告)日:2017-07-11

    申请号:US14861968

    申请日:2015-09-22

    Inventor: Alok Govil

    Abstract: Methods, systems, computer-readable storage media, and apparatuses for efficiently computing a computer vision operation are presented. In certain aspects, techniques are disclosed for receiving values from one or more pixels from a pixel array and representing those values for facilitating computer vision operations, such as Haar-like feature computations. In one implementation, the pixel values are represented as a hierarchy of computations; each level above the lower level of the hierarchy of computations comprises one or more values representing a computation of the values from a lower level of the hierarchy. The computation can include a simple sum of the values for the lower level of the hierarchy, a weighted sum of the values for the lower level of the hierarchy, an average of the values for the lower level of the hierarchy, a local binary pattern based on the values for the lower level of the hierarchy, a histogram of oriented gradients based on the values for the lower level of the hierarchy, or other computer vision feature computation based on the values for the lower level of the hierarchy. In such an implementation, the computer vision operations, such as Haar-like feature computations, may be performed using the hierarchy of averages.

    Apparatus and method for low-power object-detection in images using hardware scanning window
    17.
    发明授权
    Apparatus and method for low-power object-detection in images using hardware scanning window 有权
    使用硬件扫描窗口的图像中低功耗物体检测的装置和方法

    公开(公告)号:US09471840B2

    公开(公告)日:2016-10-18

    申请号:US14985144

    申请日:2015-12-30

    Abstract: An apparatus includes a hardware sensor array including a plurality of pixels arranged along at least a first dimension and a second dimension of the array, each of the pixels capable of generating a sensor reading. A hardware scanning window array includes a plurality of storage elements arranged along at least a first dimension and a second dimension of the hardware scanning window array, each of the storage elements capable of storing a pixel value based on one or more sensor readings. Peripheral circuitry for systematically transfers pixel values, based on sensor readings, into the hardware scanning window array, to cause different windows of pixel values to be stored in the hardware scanning window array at different times. Control logic coupled to the hardware sensor array, the hardware scanning window array, and the peripheral circuitry, provides control signals to the peripheral circuitry to control the transfer of pixel values.

    Abstract translation: 一种装置包括硬件传感器阵列,其包括沿阵列的至少第一维度和第二维度排列的多个像素,每个像素能够产生传感器读数。 硬件扫描窗口阵列包括沿着硬件扫描窗口阵列的至少第一维度和第二维度布置的多个存储元件,每个存储元件能够基于一个或多个传感器读数来存储像素值。 用于系统地将基于传感器读数的像素值传送到硬件扫描窗口阵列中的外围电路,以使像素值的不同窗口在不同时间存储在硬件扫描窗口阵列中。 耦合到硬件传感器阵列,硬件扫描窗口阵列和外围电路的控制逻辑向外围电路提供控制信号以控制像素值的传送。

    LOW-POWER ALWAYS-ON FACE DETECTION, TRACKING, RECOGNITION AND/OR ANALYSIS USING EVENTS-BASED VISION SENSOR
    18.
    发明申请
    LOW-POWER ALWAYS-ON FACE DETECTION, TRACKING, RECOGNITION AND/OR ANALYSIS USING EVENTS-BASED VISION SENSOR 有权
    使用基于事件的视觉传感器进行低功耗总体检测,跟踪,识别和/或分析

    公开(公告)号:US20160094814A1

    公开(公告)日:2016-03-31

    申请号:US14866549

    申请日:2015-09-25

    Abstract: Techniques disclosed herein utilize a vision sensor that integrates a special-purpose camera with dedicated computer vision (CV) computation hardware and a dedicated low-power microprocessor for the purposes of detecting, tracking, recognizing, and/or analyzing subjects, objects, and scenes in the view of the camera. The vision sensor processes the information retrieved from the camera using the included low-power microprocessor and sends “events” (or indications that one or more reference occurrences have occurred, and, possibly, associated data) for the main processor only when needed or as defined and configured by the application. This allows the general-purpose microprocessor (which is typically relatively high-speed and high-power to support a variety of applications) to stay in a low-power (e.g., sleep mode) most of the time as conventional, while becoming active only when events are received from the vision sensor.

    Abstract translation: 本文公开的技术利用视觉传感器,其将特殊用途相机与专用计算机视觉(CV)计算硬件和专用低功率微处理器集成,用于检测,跟踪,识别和/或分析主体,对象和场景 在相机的视野。 视觉传感器使用附带的低功率微处理器处理从摄像机检索的信息,并且仅在需要时发送主处理器的“事件”(或发生了一个或多个参考事件以及可能的关联数据),或者作为 由应用程序定义和配置。 这允许通用微处理器(通常是相对高速和大功率来支持各种应用程序)在大多数时间内保持在低功率(例如,睡眠模式)中,同时仅成为活动的 当从视觉传感器接收到事件时。

    SENSOR ARCHITECTURE USING FRAME-BASED AND EVENT-BASED HYBRID SCHEME
    19.
    发明申请
    SENSOR ARCHITECTURE USING FRAME-BASED AND EVENT-BASED HYBRID SCHEME 有权
    传感器结构使用基于框架和事件的混合方案

    公开(公告)号:US20160094796A1

    公开(公告)日:2016-03-31

    申请号:US14864700

    申请日:2015-09-24

    Inventor: Alok Govil

    Abstract: A hybrid camera sensor offers efficient image sensing by periodically evaluating pixels at a certain frame rate and disregarding values of pixels that have changed less than a threshold amount. Because only a fraction of pixels in the camera sensor may change values from frame to frame, this can result in faster readout times, which can optionally enable increased frame rates.

    Abstract translation: 混合摄像机传感器通过以特定帧速率周期性地评估像素并且忽略已经改变小于阈值量的像素的值来提供有效的图像感测。 由于相机传感器中只有一小部分像素可能会从一帧到另一帧改变数值,因此可能会导致更快的读取时间,从而可以选择启用增加的帧速率。

    HARDWARE ACCELERATION OF COMPUTER VISION FEATURE DETECTION
    20.
    发明申请
    HARDWARE ACCELERATION OF COMPUTER VISION FEATURE DETECTION 有权
    计算机视觉特征检测的硬件加速

    公开(公告)号:US20160091947A1

    公开(公告)日:2016-03-31

    申请号:US14862314

    申请日:2015-09-23

    Abstract: Techniques describe apparatus and method for generating local binary pattern (LBP) labels based on sensor readings from sensor elements. The sensor apparatus may include a sensor element array that includes a plurality of sensor elements and may also include in-pixel circuitry coupled directly to the sensor element, peripheral circuitry coupled to the sensor element array and configured to receive output from one or more of sensor elements and digital circuitry. The in-pixel circuitry and/or peripheral circuitry may include an analog and/or digital computation structure configured to generate an LBP label for each of the sensor elements readings, by currently comparing the sensor readings for the referenced sensor element with the sensor readings of four or less neighboring sensor elements, and using previously, or subsequently, generated comparisons for the remaining neighboring sensor elements.

    Abstract translation: 技术描述了基于传感器元件的传感器读数产生局部二进制模式(LBP)标签的装置和方法。 传感器设备可以包括传感器元件阵列,其包括多个传感器元件,并且还可以包括直接耦合到传感器元件的像素内电路,耦合到传感器元件阵列的外围电路,并被配置为从一个或多个传感器 元件和数字电路。 像素内电路和/或外围电路可以包括模拟和/或数字计算结构,其被配置为通过将参考的传感器元件的传感器读数与传感器读数的传感器读数进行比较来生成每个传感器元件读数的LBP标签 四个或更少的相邻传感器元件,并且对于剩余的相邻传感器元件使用先前或随后的生成的比较。

Patent Agency Ranking