Acoustic camera based audio visual scene analysis

    公开(公告)号:US09736580B2

    公开(公告)日:2017-08-15

    申请号:US14662880

    申请日:2015-03-19

    CPC classification number: H04R3/005 G01S3/80 G01S3/801 G01S3/8083

    Abstract: Techniques are disclosed for scene analysis including the use of acoustic imaging and computer audio vision processes for monitoring applications. In some embodiments, an acoustic image device is utilized with a microphone array, image sensor, acoustic image controller, and a controller. In some cases, the controller analyzes at least a portion of the spatial spectrum within the acoustic image data to detect sound variations by identifying regions of pixels having intensities exceeding a particular threshold. In addition, the controller can detect two or more co-occurring sound events based on the relative distance between pixels with intensities exceeding the threshold. The resulting data fusion of image pixel data, audio sample data, and acoustic image data can be analyzed using computer audio vision, sound/voice recognition, and acoustic signature techniques to recognize/identify audio and visual features associated with the event and to empirically or theoretically determine one or more conditions causing each event.

Patent Agency Ranking