Feature computation in a sensor element array

    公开(公告)号:US09838635B2

    公开(公告)日:2017-12-05

    申请号:US14862319

    申请日:2015-09-23

    Abstract: Techniques describe computing computer vision (CV) features based on sensor readings from a sensor and detecting macro-features based on the CV features. The sensor may include a sensor element array that includes a plurality of sensor elements. The sensor may also include in-pixel circuitry coupled to the sensor elements, peripheral circuitry and/or a dedicated microprocessor coupled to the sensor element array. The in-pixel circuitry, the peripheral circuitry or the dedicated microprocessor may include computation structures configured to perform analog or digital operations representative of a multi-pixel computation for a sensor element (or block of sensor elements), based on sensor readings generated by neighboring sensor elements in proximity to the sensor element, and to generate CV features. The dedicated microprocessor may process the CV features and detect macro-features. Furthermore, in certain embodiments, the dedicated microprocessor may be coupled to a second microprocessor through a wired or wireless interface.

    Retina prosthesis
    4.
    发明授权
    Retina prosthesis 有权
    视网膜假体

    公开(公告)号:US09180309B2

    公开(公告)日:2015-11-10

    申请号:US13821187

    申请日:2011-08-25

    CPC classification number: A61N5/0622 A61N1/36046 G06K9/605 G06N3/049

    Abstract: This disclosure provides a retinal prosthetic method and device that mimics the responses of the retina to a broad range of stimuli, including natural stimuli. Ganglion cell firing patterns are generated in response to a stimulus using a set of encoders, interfaces, and transducers, where each transducer targets a single cell or a small number of cells. The conversion occurs on the same time scale as that carried out by the normal retina. In addition, aspects of the invention may be used with robotic or other mechanical devices, where processing of visual information is required. The encoders may be adjusted over time with aging or the progression of a disease.

    Abstract translation: 本公开提供了视网膜假体方法和装置,其模拟视网膜对广泛范围的刺激(包括天然刺激)的反应。 响应于使用一组编码器,接口和换能器的刺激来产生神经节细胞发射模式,其中每个换能器靶向单个细胞或少量细胞。 转换发生在与正常视网膜相同的时间尺度上。 此外,本发明的方面可以与机器人或其他机械装置一起使用,其中需要视觉信息的处理。 随着老化或疾病的进展,编码器可随时间而被调整。

    Image sensor having output of integral image
    6.
    发明授权
    Image sensor having output of integral image 有权
    具有整体图像输出的图像传感器

    公开(公告)号:US08243167B2

    公开(公告)日:2012-08-14

    申请号:US12494224

    申请日:2009-06-29

    CPC classification number: G06K9/605 G06K9/4614 H01L27/14609

    Abstract: An image sensor having an output of an integral image is provided. The image sensor includes a pixel circuit, a line accumulator, and a volume accumulator. The pixel circuit includes a plurality of pixels for capturing pixel values of the pixels. The line accumulator is used for accumulating the pixel values of the pixels from a first pixel to a target pixel in a target pixel line of the image so as to obtain an accumulated line pixel value. The volume accumulator is used for adding the accumulated line pixel value output by the line accumulator to an integral pixel value of the pixel corresponding to the target pixel in a previous pixel line of the target pixel line, and using an adding result as the integral pixel value of the target pixel, so as to output the integral pixel value of the target pixel to form an integral image.

    Abstract translation: 提供具有整体图像的输出的图像传感器。 图像传感器包括像素电路,线路累加器和体积累加器。 像素电路包括用于捕获像素的像素值的多个像素。 线累加器用于将像素的像素值从图像的目标像素行中的第一像素累积到目标像素,以获得累积行像素值。 音量累加器用于将线性累加器输出的累积线像素值与对象像素线的先前像素线中的目标像素对应的像素的整体像素值相加,并使用相加结果作为整数像素 值,以便输出目标像素的积分像素值以形成整体图像。

    Method and apparatus for performing neighborhood operations on a
processing plane
    7.
    发明授权
    Method and apparatus for performing neighborhood operations on a processing plane 失效
    在处理平面上执行邻域操作的方法和装置

    公开(公告)号:US5270963A

    公开(公告)日:1993-12-14

    申请号:US549423

    申请日:1990-07-06

    CPC classification number: G06K9/605 G06K9/00986 G06K9/56 G06N3/0635 G06T5/20

    Abstract: The present invention is a method and apparatus for performing neighborhood processing operations on an n dimensional processing plane. In a simple, two dimensional, example, an M by N processing plane is successively scanned by rows. The output information from each row is presented on column lines. The analog data resulting from a fixed number of successive scans are temporarily held in a multi-stage analog buffer. A computing array is configured to perform the neighborhood operations or other limited co-operand operations on the shifted data. The computing array examines information from a slice made up of selected numbers of successive rows of the entire array, performs the operations on that portion, and provides a series of output signals representative of the result. The analog buffer is pipelined; information from a new row represents only a single row of new data and the contents of the latch stage containing the oldest information is replaced with this new analog data, causing the information from the transducers of the oldest row to be lost. The operation is then performed on the new slice. This sequence is repeated until all representative slices of the total array have had the neighborhood operations performed on them.

    Abstract translation: 本发明是一种用于在n维处理平面上执行邻域处理操作的方法和装置。 在简单的二维例子中,逐行扫描M×N处理平面。 来自每一行的输出信息都列在列线上。 由固定数量的连续扫描产生的模拟数据暂时保存在多级模拟缓冲器中。 计算阵列被配置为对移位的数据执行邻域操作或其他有限的协同操作数操作。 计算阵列检查来自由整个阵列的选定数目的连续行组成的切片的信息,对该部分执行操作,并提供表示结果的一系列输出信号。 模拟缓冲器是流水线的; 来自新行的信息仅代表单行新数据,并且包含最旧信息的锁存级的内容被该新的模拟数据替代,导致来自最旧行的换能器的信息丢失。 然后在新切片上执行操作。 重复该顺序,直到总阵列的所有代表性切片都对它们执行邻域操作。

    Thin-film neuron network with optical programming
    8.
    发明授权
    Thin-film neuron network with optical programming 失效
    薄膜神经网络光学编程

    公开(公告)号:US5212377A

    公开(公告)日:1993-05-18

    申请号:US838241

    申请日:1992-02-28

    Inventor: Karlheinz Rosan

    CPC classification number: G06K9/605 G06N3/063 G06N3/0675 G11C7/005

    Abstract: A synapse matrix and a device for optical programming are contained integrated in thin-film technology in a common substrate (1). The synapses consist of photoelectric elements. The device for optical programming consists, for example, of a liquid crystal screen or an arrangement of electroluminescent diodes. It is within the scope of the invention that neurons in thin-film technology, contained in the neuron network, are also integrated on the substrate. The neuron network can be used especially for pattern recognition.

    Abstract translation: PCT No.PCT / DE90 / 00021 Sec。 一九九二年二月二十八日 102(e)日期1992年2月28日PCT 1990年1月16日PCT PCT。 公开号WO91 / 03798 1991年3月21日。突触矩阵和用于光学编程的装置被集成在公共衬底(1)中的薄膜技术中。 突触由光电元件组成。 用于光学编程的装置例如由液晶屏或电致发光二极管的布置组成。 包含在神经网络中的薄膜技术中的神经元也在本发明的范围内,也集成在基板上。 神经元网络可以特别用于模式识别。

Patent Agency Ranking