HARDWARE ACCELERATION OF COMPUTER VISION FEATURE DETECTION
    3.
    发明公开
    HARDWARE ACCELERATION OF COMPUTER VISION FEATURE DETECTION 审中-公开
    硬件加速计算机视觉特征检测

    公开(公告)号:EP3201828A1

    公开(公告)日:2017-08-09

    申请号:EP15778824.1

    申请日:2015-09-24

    IPC分类号: G06K9/00 G06F3/03 G06K9/46

    摘要: Techniques describe apparatus and method for generating local binary pattern (LBP) labels based on sensor readings from sensor elements. The sensor apparatus may include a sensor element array that includes a plurality of sensor elements and may also include in-pixel circuitry coupled directly to the sensor element, peripheral circuitry coupled to the sensor element array and configured to receive output from one or more of sensor elements and digital circuitry. The in-pixel circuitry and/or peripheral circuitry may include an analog and/or digital computation structure configured to generate an LBP label for each of the sensor elements readings, by currently comparing the sensor readings for the referenced sensor element with the sensor readings of four or less neighboring sensor elements, and using previously, or subsequently, generated comparisons for the remaining neighboring sensor elements.

    摘要翻译: 技术描述了用于基于来自传感器元件的传感器读数生成局部二元模式(LBP)标签的设备和方法。 传感器装置可以包括传感器元件阵列,其包括多个传感器元件并且还可以包括直接耦合到传感器元件的像素内电路,外围电路耦合到传感器元件阵列并且被配置为接收来自传感器元件阵列中的一个或多个传感器 元素和数字电路。 像素内电路和/或外围电路可以包括模拟和/或数字计算结构,该模拟和/或数字计算结构被配置为通过将参考传感器元件的传感器读数与传感器元件读数的传感器读数进行比较来为每个传感器元件读数生成LBP标签 四个或更少的相邻传感器元件,并且使用先前或随后对剩余的相邻传感器元件生成的比较。

    CONFIGURABLE HARDWARE FOR COMPUTING COMPUTER VISION FEATURES
    5.
    发明公开
    CONFIGURABLE HARDWARE FOR COMPUTING COMPUTER VISION FEATURES 审中-公开
    用于计算计算机视觉功能的可配置硬件

    公开(公告)号:EP3201836A1

    公开(公告)日:2017-08-09

    申请号:EP15781796.6

    申请日:2015-09-24

    IPC分类号: G06K9/60

    摘要: Techniques describe apparatus and method for generating computed results based on sensor readings for detecting features, such as edges, corners etc. The sensor apparatus may include a sensor element array that includes a plurality of sensor elements. The sensor elements may be arranged in a 2-dimensional array, such as columns and rows. The sensor elements may be capable of generating sensor reading based on environmental conditions. The sensor apparatus may include a dedicated computer vision (CV) computation hardware in in-pixel circuitry, peripheral circuitry or dedicated microprocessor coupled to the sensor element array and configured to receive output from one or more of sensor elements. The dedicated CV computation hardware may include configurable blocks for detecting features using CV operations, wherein the configurable blocks may be configured to switch between multiple CV operations, such as linear binary pattern (LBP) and/or histogram of signed gradient (HSG) computer vision operations.

    摘要翻译: 技术描述了用于基于用于检测特征(诸如边缘,拐角等)的传感器读数来生成计算结果的装置和方法。传感器装置可以包括传感器元件阵列,其包括多个传感器元件。 传感器元件可以布置成二维阵列,例如列和行。 传感器元件可以能够基于环境条件生成传感器读数。 传感器装置可以包括像素内电路中的专用计算机视觉(CV)计算硬件,外围电路或耦合到传感器元件阵列并被配置为接收来自一个或多个传感器元件的输出的专用微处理器。 专用CV计算硬件可以包括用于使用CV操作来检测特征的可配置块,其中可配置块可以被配置为在多个CV操作(诸如线性二进制图案(LBP)和/或带符号梯度(HSG)计算机视觉的直方图 操作。

    FEATURE COMPUTATION IN A SENSOR ELEMENT ARRAY
    6.
    发明公开
    FEATURE COMPUTATION IN A SENSOR ELEMENT ARRAY 审中-公开
    传感器元件阵列中的特征计算

    公开(公告)号:EP3201830A1

    公开(公告)日:2017-08-09

    申请号:EP15781797.4

    申请日:2015-09-24

    IPC分类号: G06K9/00 G06K9/46 G06K9/60

    摘要: Techniques describe computing computer vision (CV) features based on sensor readings from a sensor and detecting macro-features based on the CV features. The sensor may include a sensor element array that includes a plurality of sensor elements. The sensor may also include in-pixel circuitry coupled to the sensor elements, peripheral circuitry and/or a dedicated microprocessor coupled to the sensor element array. The in-pixel circuitry, the peripheral circuitry or the dedicated microprocessor may include computation structures configured to perform analog or digital operations representative of a multi-pixel computation for a sensor element (or block of sensor elements), based on sensor readings generated by neighboring sensor elements in proximity to the sensor element, and to generate CV features. The dedicated microprocessor may process the CV features and detect macro-features. Furthermore, in certain embodiments, the dedicated microprocessor may be coupled to a second microprocessor through a wired or wireless interface.

    摘要翻译: 技术描述了基于来自传感器的传感器读数计算计算机视觉(CV)特征并基于CV特征检测宏特征。 传感器可以包括包括多个传感器元件的传感器元件阵列。 传感器还可以包括耦合到传感器元件的像素内电路,外围电路和/或耦合到传感器元件阵列的专用微处理器。 像素内电路,外围电路或专用微处理器可以包括计算结构,该计算结构被配置为基于由相邻像素生成的传感器读数执行代表传感器元件(或传感器元件块)的多像素计算的模拟或数字操作 传感器元件靠近传感器元件,并产生CV特征。 专用微处理器可能会处理CV功能并检测宏功能。 此外,在某些实施例中,专用微处理器可以通过有线或无线接口耦合到第二微处理器。

    EVENT BASED COMPUTER VISION COMPUTATION
    7.
    发明公开
    EVENT BASED COMPUTER VISION COMPUTATION 审中-公开
    基于事件的计算机视觉计算

    公开(公告)号:EP3201827A1

    公开(公告)日:2017-08-09

    申请号:EP15778823.3

    申请日:2015-09-24

    IPC分类号: G06K9/00 G06F3/03 G06K9/46

    摘要: Certain techniques are provided for triggering events based on detecting changes in CV features, such as edges, corners etc., by generating computed results based on sensor readings. Yet other techniques also provided for detecting CV features once an event is detecting based on a change in a sensor reading for a sensor element. In certain aspects, the event detection logic and the feature calculation CV vision operations may be performed, individually, or in combination in circuitry on a sensor or in software/firmware on a computing device.

    摘要翻译: 通过基于传感器读数生成计算结果,基于检测CV特征中的变化(诸如边缘,拐角等)来提供触发事件的某些技术。 还提供了其他技术,用于一旦基于传感器元件的传感器读数的变化检测到事件就检测CV特征。 在某些方面,事件检测逻辑和特征计算CV视觉操作可以单独地或组合地在传感器上的电路上或在计算设备上的软件/固件中执行。