HIERARCHICAL DATA ORGANIZATION FOR DENSE OPTICAL FLOW PROCESSING IN A COMPUTER VISION SYSTEM

    公开(公告)号:US20210049368A1

    公开(公告)日:2021-02-18

    申请号:US17086560

    申请日:2020-11-02

    Abstract: A computer vision system is provided that includes an image generation device configured to capture consecutive two dimensional (2D) images of a scene, a first memory configured to store the consecutive 2D images, a second memory configured to store a growing window of consecutive rows of a reference image and a growing window of consecutive rows of a current image, wherein the reference image and the current image are a pair of consecutive 2D images stored in the first memory, a third memory configured to store a sliding window of pixels fetched from the growing window of the reference image, wherein the pixels in the sliding window are stored in tiles, and a dense optical flow engine (DOFE) configured to determine a dense optical flow map for the pair of consecutive 2D images, wherein the DOFE uses the sliding window as a search window for pixel correspondence searches.

    DENSE OPTICAL FLOW PROCESSING IN A COMPUTER VISION SYSTEM

    公开(公告)号:US20200027219A1

    公开(公告)日:2020-01-23

    申请号:US16585333

    申请日:2019-09-27

    Abstract: A computer vision system is provided that includes an image generation device configured to generate consecutive two dimensional (2D) images of a scene, and a dense optical flow engine (DOFE) configured to determine a dense optical flow map for pairs of the consecutive 2D images, wherein, for a pair of consecutive 2D images, the DOFE is configured to perform a predictor based correspondence search for each paxel in a current image of the pair of consecutive 2D images, wherein, for an anchor pixel in each paxel, the predictor based correspondence search evaluates a plurality of predictors to select a best matching pixel in a reference image of the pair of consecutive 2D images, and determine optical flow vectors for each pixel in a paxel based on the best matching pixel selected for the anchor pixel of the paxel.

    System and method for an efficient hardware implementation of census transform

    公开(公告)号:US10325174B2

    公开(公告)日:2019-06-18

    申请号:US15707695

    申请日:2017-09-18

    Abstract: Systems and methods for performing Census Transforms that includes an input from an image, with a support window created within the image, and a kernel within the support window. The Census Transform calculations and comparisons are performed within the kernel windows. One disclosed method allows for previously performed comparison to be calculated and compared as an if not equal invert or if equal use pervious comparison hardware design. Alternatively, a new Census Transform is disclosed which always inverts a previously made comparison. This new approach can be demonstrated to be equivalent to, applying the original Census Transform, on a pre-processed input kernel, where the pre-processing step adds a fractional position index to each pixel within the N×N kernel. The fractional positional index ensures that no two pixels are equal to one another, and thereby makes the Original Census algorithm on pre-processed kernel same as the new Census algorithm on original kernel. The hardware design for this new Census Transform kernel allows for an always invert of previous comparison system resulting in reduced hardware and power consumption.

    APPARATUS FOR DETECTING FAULTS IN VIDEO FRAMES OF VIDEO SEQUENCE
    5.
    发明申请
    APPARATUS FOR DETECTING FAULTS IN VIDEO FRAMES OF VIDEO SEQUENCE 有权
    用于检测视频序列视频帧中的故障的装置

    公开(公告)号:US20160117557A1

    公开(公告)日:2016-04-28

    申请号:US14923753

    申请日:2015-10-27

    CPC classification number: G06T7/001 H04N17/004

    Abstract: A fault detection circuit for detecting faults in a video sequence includes a multiple input signature register (MISR) with a linear feedback shift register (LFSR) that receives pixel data for pixels in a frame region for video frames of a video sequence and receives a read signal to read the pixel data and shift the MISR; a multiple signature storage buffer (MSSB) that stores frame signatures; and a signature comparator that compares current and reference frame signatures to determine if a fault condition exists in the video sequence. The MISR holds a frame signature for the frame region of the video frame while receiving a frame end signal. The MSSB stores a current frame signature held by the MISR after receiving the frame end signal. The MSSB also stores a reference frame signature. A display processing circuit includes the fault detection circuit. An integrated circuit includes the display processing circuit.

    Abstract translation: 用于检测视频序列中的故障的故障检测电路包括具有线性反馈移位寄存器(LFSR)的多输入签名寄存器(MISR),其接收用于视频序列的视频帧的帧区域中的像素的像素数据,并且接收读取 信号读取像素数据并移位MISR; 存储帧签名的多个签名存储缓冲器(MSSB); 以及比较当前和参考帧签名以确定视频序列中是否存在故障条件的签名比较器。 MISR在接收到帧结束信号的同时保持视频帧的帧区域的帧签名。 MSSB在接收到帧结束信号之后存储由MISR保存的当前帧签名。 MSSB还存储参考帧签名。 显示处理电路包括故障检测电路。 集成电路包括显示处理电路。

    DENSE OPTICAL FLOW PROCESSING IN A COMPUTER VISION SYSTEM

    公开(公告)号:US20220084215A1

    公开(公告)日:2022-03-17

    申请号:US17533256

    申请日:2021-11-23

    Abstract: A computer vision system is provided that includes an image generation device configured to generate consecutive two dimensional (2D) images of a scene, and a dense optical flow engine (DOFE) configured to determine a dense optical flow map for pairs of the consecutive 2D images, wherein, for a pair of consecutive 2D images, the DOFE is configured to perform a predictor based correspondence search for each paxel in a current image of the pair of consecutive 2D images, wherein, for an anchor pixel in each paxel, the predictor based correspondence search evaluates a plurality of predictors to select a best matching pixel in a reference image of the pair of consecutive 2D images, and determine optical flow vectors for each pixel in a paxel based on the best matching pixel selected for the anchor pixel of the paxel.

    Dense optical flow processing in a computer vision system

    公开(公告)号:US11182908B2

    公开(公告)日:2021-11-23

    申请号:US16585333

    申请日:2019-09-27

    Abstract: A computer vision system is provided that includes an image generation device configured to generate consecutive two dimensional (2D) images of a scene, and a dense optical flow engine (DOFE) configured to determine a dense optical flow map for pairs of the consecutive 2D images, wherein, for a pair of consecutive 2D images, the DOFE is configured to perform a predictor based correspondence search for each paxel in a current image of the pair of consecutive 2D images, wherein, for an anchor pixel in each paxel, the predictor based correspondence search evaluates a plurality of predictors to select a best matching pixel in a reference image of the pair of consecutive 2D images, and determine optical flow vectors for each pixel in a paxel based on the best matching pixel selected for the anchor pixel of the paxel.

    Image processing accelerator
    8.
    发明授权

    公开(公告)号:US10747692B2

    公开(公告)日:2020-08-18

    申请号:US16234508

    申请日:2018-12-27

    Abstract: A processing accelerator includes a shared memory, and a stream accelerator, a memory-to-memory accelerator, and a common DMA controller coupled to the shared memory. The stream accelerator is configured to process a real-time data stream, and to store stream accelerator output data generated by processing the real-time data stream in the shared memory. The memory-to-memory accelerator is configured to retrieve input data from the shared memory, to process the input data, and to store, in the shared memory, memory-to-memory accelerator output data generated by processing the input data. The common DMA controller is configured to retrieve stream accelerator output data from the shared memory and transfer the stream accelerator output data to memory external to the processing accelerator; and to retrieve the memory-to-memory accelerator output data from the shared memory and transfer the memory-to-memory accelerator output data to memory external to the processing accelerator.

    Sparse optical flow support in an optical flow system

    公开(公告)号:US10380746B2

    公开(公告)日:2019-08-13

    申请号:US15784285

    申请日:2017-10-16

    Abstract: An optical flow system includes a binary mask generation circuit and an optical flow circuit. The binary mask generation circuit is configured to receive a plurality of points of interest from a captured image that contains an array of pixels arranged as rows and columns and includes width lines that correspond to the rows and height lines that correspond to the columns. The binary mask generation circuit is also configured to generate a binary mask based on the plurality of points of interest. The binary mask includes a representation of a subset of the plurality of points of interest. The optical flow circuit is configured to receive the binary mask and generate an optical flow map of the subset of the plurality of points of interest.

    SYSTEM AND METHOD FOR AN EFFICIENT HARDWARE IMPLEMENTATION OF CENSUS TRANSFORM

    公开(公告)号:US20190244051A1

    公开(公告)日:2019-08-08

    申请号:US16386723

    申请日:2019-04-17

    Abstract: Systems and methods for performing Census Transforms that includes an input from an image, with a support window created within the image, and a kernel within the support window. The Census Transform calculations and comparisons are performed within the kernel windows. A new Census Transform is disclosed which always inverts a previously made comparison. This new approach can be demonstrated to be equivalent to, applying the original Census Transform, on a pre-processed input kernel, where the pre-processing step adds a fractional position index to each pixel within the N×N kernel. The fractional positional index ensures that no two pixels are equal to one another, and thereby makes the Original Census algorithm on pre-processed kernel same as the new Census algorithm on original kernel. The hardware design for this new Census Transform kernel allows for an always invert of previous comparison system resulting in reduced hardware and power consumption.

Patent Agency Ranking