JOINTLY LEARNING VISUAL MOTION AND CONFIDENCE FROM LOCAL PATCHES IN EVENT CAMERAS

    公开(公告)号:US20210158483A1

    公开(公告)日:2021-05-27

    申请号:US17105028

    申请日:2020-11-25

    Abstract: A method may include obtaining a set of events, of a set of pixels of a dynamic vision sensor, associated with an object; determining a set of voltages of the set of pixels, based on the set of events; generating a set of images, based on the set of voltages of the set of pixels; inputting the set of images into a first neural network configured to output a visual motion estimation of the object; inputting the set of images into a second neural network configured to output a confidence score of the visual motion estimation output by the first neural network; obtaining the visual motion estimation of the object and the confidence score of the visual motion estimation of the object, based on inputting the set of images into the first neural network and the second neural network; and providing the visual motion estimation of the object and the confidence score.

    Acoustic collision detection and localization for robotic devices

    公开(公告)号:US11714163B2

    公开(公告)日:2023-08-01

    申请号:US17084257

    申请日:2020-10-29

    CPC classification number: G01S5/22 B25J19/026

    Abstract: A method of collision localization on a robotic device includes obtaining audio signals from a plurality of acoustic sensors spaced apart along the robotic device; identifying, based on a collision being detected, a strongest audio signal; identifying a primary onset time for an acoustic sensor producing the strongest audio signal, the primary onset time being a time at which waves propagating from the collision reach the acoustic sensor producing the strongest audio signal; generating a virtual onset time set, by shifting a calibration manifold, based on the identified primary onset time, the calibration manifold representing relative onset times from evenly spaced marker locations on the robotic device to the plurality of acoustic sensors; determining scores for the marker locations based a standard deviation of elements in the virtual onset time set; and estimating a location of the collision based on a highest score of the determined scores.

Patent Agency Ranking