Invention Grant
- Patent Title: Localized audio source extraction from video recordings
- Patent Title (中): 从录像中提取本地化音频源
-
Application No.: US14380698Application Date: 2013-12-09
-
Publication No.: US09432720B2Publication Date: 2016-08-30
- Inventor: Ezekiel Kruglick
- Applicant: Empire Technology Development LLC
- Applicant Address: US DE Wilmington
- Assignee: EMPIRE TECHNOLOGY DEVELOPMENT LLC
- Current Assignee: EMPIRE TECHNOLOGY DEVELOPMENT LLC
- Current Assignee Address: US DE Wilmington
- Agency: Turk IP Law, LLC
- International Application: PCT/US2013/073939 WO 20131209
- International Announcement: WO2015/088484 WO 20150618
- Main IPC: H04N21/43
- IPC: H04N21/43 ; G11B27/10 ; G11B27/036 ; H04N21/439 ; H04N21/44 ; H04N21/81

Abstract:
Technologies are generally described for a system to process a collection of video recordings of a scene to extract and localize audio sources for the audio data. According to some examples, video recordings captured by mobile devices from different perspectives may be uploaded to a central database. Video segments capturing an overlapping portion of the scene at an overlapping time may be identified, and a relative location of each of the video capturing devices may be determined. Audio data for the video segments may be indexed with a sub-frame time reference and relative locations as a function of overlapping time. Using the indices that include the sub-frame time references and relative locations, audio sources for the audio data may be extracted and localized. The extracted audio sources may be transcribed and indexed to enable searching, and may be added back to each video recording as a separate audio channel.
Public/Granted literature
- US20150350716A1 LOCALIZED AUDIO SOURCE EXTRACTION FROM VIDEO RECORDINGS Public/Granted day:2015-12-03
Information query