MULTISCALE WEIGHTED MATCHING AND SENSOR FUSION FOR DYNAMIC VISION SENSOR TRACKING

    公开(公告)号:US20200043196A1

    公开(公告)日:2020-02-06

    申请号:US16597846

    申请日:2019-10-09

    IPC分类号: G06T7/73

    摘要: A Dynamic Vision Sensor (DVS) pose-estimation system includes a DVS, a transformation estimator, an inertial measurement unit (IMU) and a camera-pose estimator based on sensor fusion. The DVS detects DVS events and shapes frames based on a number of accumulated DVS events. The transformation estimator estimates a 3D transformation of the DVS camera based on an estimated depth and matches confidence-level values within a camera-projection model such that at least one of a plurality of DVS events detected during a first frame corresponds to a DVS event detected during a second subsequent frame. The IMU detects inertial movements of the DVS with respect to world coordinates between the first and second frames. The camera-pose estimator combines information from a change in a pose of the camera-projection model between the first frame and the second frame based on the estimated transformation and the detected inertial movements of the DVS.

    APPARATUS AND METHOD FOR GENERATING EFFICIENT CONVOLUTION

    公开(公告)号:US20190325004A1

    公开(公告)日:2019-10-24

    申请号:US16460564

    申请日:2019-07-02

    IPC分类号: G06F17/15 G06F7/556 G06F7/544

    摘要: A method of manufacturing an apparatus and a method of constructing an integrated circuit are provided. The method of manufacturing an apparatus includes forming the apparatus on a wafer or a package with at least one other apparatus, wherein the apparatus comprises a polynomial generator, a first matrix generator, a second matrix generator, a third matrix generator, and a convolution generator; and testing the apparatus, wherein testing the apparatus comprises testing the apparatus using one or more electrical to optical converters, one or more optical splitters that split an optical signal into two or more optical signals, and one or more optical to electrical converters.

    METHOD AND ALGORITHM OF RECURSIVE DEEP LEARNING QUANTIZATION FOR WEIGHT BIT REDUCTION

    公开(公告)号:US20180197081A1

    公开(公告)日:2018-07-12

    申请号:US15464330

    申请日:2017-03-20

    IPC分类号: G06N3/08 G06F17/11

    CPC分类号: G06N3/08 G06N3/0454 G06N3/063

    摘要: A system and method to reduce weight storage bits for a deep-learning network includes a quantizing module and a cluster-number reduction module. The quantizing module quantizes neural weights of each quantization layer of the deep-learning network. The cluster-number reduction module reduces the predetermined number of clusters for a layer having a clustering error that is a minimum of the clustering errors of the plurality of quantization layers. The quantizing module requantizes the layer based on the reduced predetermined number of clusters for the layer and the cluster-number reduction module further determines another layer having a clustering error that is a minimum of the clustering errors of the plurality of quantized layers and reduces the predetermined number of clusters for the another layer until a recognition performance of the deep-learning network has been reduced by a predetermined threshold.

    MULTISCALE WEIGHTED MATCHING AND SENSOR FUSION FOR DYNAMIC VISION SENSOR TRACKING

    公开(公告)号:US20180174323A1

    公开(公告)日:2018-06-21

    申请号:US15458016

    申请日:2017-03-13

    IPC分类号: G06T7/73 G06T5/00 G06T7/593

    摘要: A Dynamic Vision Sensor (DVS) pose-estimation system includes a DVS, a transformation estimator, an inertial measurement unit (IMU) and a camera-pose estimator based on sensor fusion. The DVS detects DVS events and shapes frames based on a number of accumulated DVS events. The transformation estimator estimates a 3D transformation of the DVS camera based on an estimated depth and matches confidence-level values within a camera-projection model such that at least one of a plurality of DVS events detected during a first frame corresponds to a DVS event detected during a second subsequent frame. The IMU detects inertial movements of the DVS with respect to world coordinates between the first and second frames. The camera-pose estimator combines information from a change in a pose of the camera-projection model between the first frame and the second frame based on the estimated transformation and the detected inertial movements of the DVS.

    DYNAMIC VISION SENSOR WITH SHARED PIXELS AND TIME DIVISION MULTIPLEXING FOR HIGHER SPATIAL RESOLUTION AND BETTER LINEAR SEPARABLE DATA
    9.
    发明申请
    DYNAMIC VISION SENSOR WITH SHARED PIXELS AND TIME DIVISION MULTIPLEXING FOR HIGHER SPATIAL RESOLUTION AND BETTER LINEAR SEPARABLE DATA 审中-公开
    具有共享像素的动态视觉传感器和用于更高空间分辨率和更好的线性可分离数据的时间分段多路复用

    公开(公告)号:US20160093273A1

    公开(公告)日:2016-03-31

    申请号:US14550899

    申请日:2014-11-21

    IPC分类号: G09G5/391

    CPC分类号: G01S3/781

    摘要: A Dynamic Vision Sensor (DVS) where pixel pitch is reduced to increase spatial resolution. The DVS includes shared pixels that employ Time Division Multiplexing (TDM) for higher spatial resolution and better linear separation of pixel data. The pixel array in the DVS may consist of multiple N×N pixel clusters. The N×N pixels in each cluster share the same differentiator and the same comparator using TDM. The pixel pitch is reduced (and, hence, the spatial resolution is improved) by implementing multiple adjacent photodiodes/photoreceptors that share the same differentiator and comparator units using TDM. In the DVS, only one quarter of the whole pixel array may be in use at the same time. A global reset may be done periodically to switch from one quarter of pixels to the other for detection. Because of higher spatial resolution, applications such as gesture recognition or user recognition based on DVS output entail improved performance.

    摘要翻译: 动态视觉传感器(DVS),其中减少像素间距以增加空间分辨率。 DVS包括采用时分复用(TDM)的共享像素,用于更高的空间分辨率和更好的线性分离像素数据。 DVS中的像素阵列可以由多个N×N个像素簇组成。 每个集群中的N×N个像素共享相同的微分器和相同的比较器使用TDM。 通过实现使用TDM共享相同的微分器和比较器单元的多个相邻光电二极管/感光器,减小了像素间距(并且因此提高了空间分辨率)。 在DVS中,整个像素阵列中只有四分之一可能同时使用。 全局复位可以周期性地从四分之一像素切换到另一个以进行检测。 由于更高的空间分辨率,诸如基于DVS输出的​​手势识别或用户识别等应用需要提高性能。