-
公开(公告)号:US09826211B2
公开(公告)日:2017-11-21
申请号:US14654944
申请日:2013-12-27
Inventor: Hirotaka Sawa , Shinichi Shigenaga , Toshimichi Tokuda , Shintaro Yoshikuni , Shuichi Watanabe , Tadashi Maki , Hirokazu Tasaka , Susumu Ono , Keisuke Fujimoto , Shojiro Matsuo , Teppei Fukuda , Hiroyuki Matsumoto , Akitoshi Izumi , Hisashi Tsuji , Kazunori Hayashi , Ryoichi Yuge
IPC: H04N9/80 , H04N9/802 , G11B31/00 , H04N5/93 , H04N21/234 , H04N21/81 , H04R3/00 , H04N9/82 , H04N9/87 , H04N5/225 , G11B27/34 , H04R1/08 , H04R27/00 , G11B27/10 , H04R1/04 , H04R1/40 , H04R29/00
CPC classification number: H04N9/802 , G11B27/10 , G11B27/34 , G11B31/006 , H04N5/2252 , H04N5/93 , H04N9/8211 , H04N9/87 , H04N21/23412 , H04N21/8106 , H04R1/04 , H04R1/08 , H04R1/086 , H04R1/406 , H04R3/005 , H04R27/00 , H04R29/008 , H04R2201/021 , H04R2410/07 , H04R2499/15
Abstract: A recorder receives designation of a video which is desired to be reproduced from a user. If designation of one or more designated locations where sound is emphasized on a screen of a display which displays the video is received by the recorder from the user via an operation unit during reproduction or temporary stopping of the video, a signal processing unit performs an emphasis process on audio data, that is, the signal processing unit emphasizes audio data in directions directed toward positions corresponding to the designated locations from a microphone array by using audio data recorded in the recorder. A reproducing device reproduces the emphasis-processed audio data and video data in synchronization with each other.
-
公开(公告)号:US09860439B2
公开(公告)日:2018-01-02
申请号:US14767411
申请日:2014-02-14
Inventor: Hirotaka Sawa , Toshimichi Tokuda , Shinichi Shigenaga , Shuichi Watanabe , Shojiro Matsuo , Takashi Hirabara , Tadashi Maki , Hisashi Tsuji , Teppei Fukuda , Akitoshi Izumi , Shintaro Yoshikuni , Hiroyuki Matsumoto , Kazunori Hayashi , Kosuke Shinozaki
IPC: H04N7/18 , H04N5/77 , H04N9/80 , H04N5/232 , G01S3/785 , H04R1/04 , H04R1/40 , G01S3/786 , H04S7/00
CPC classification number: H04N5/23216 , G01S3/785 , G01S3/7864 , H04N5/23293 , H04N5/23296 , H04R1/04 , H04R1/406 , H04R2201/401 , H04R2430/23 , H04S7/00 , H04S2420/01
Abstract: Sound collection directionality is formed toward a location corresponding to a position designated in a video of a predetermined region which is imaged by a camera apparatus with a microphone array apparatus as a reference, and audio data is collected with high accuracy. In a directionality control system (10), a signal processing unit (33) derives a sound collection direction (θMAh,θMAv) which is directed from an installation position of a microphone array apparatus (2) toward a sound position corresponding to a position designated in video data on a screen of the display device (36) in response to a user's designation of any position in the video data displayed on the screen. The signal processing unit (33) forms sound collection directionality of audio data in the derived sound collection direction (θMAh,θMAv).
-
公开(公告)号:US10824876B2
公开(公告)日:2020-11-03
申请号:US15338814
申请日:2016-10-31
Inventor: Hiroyuki Matsumoto , Shintaro Yoshikuni
IPC: G06T7/73 , H04N5/272 , G06K9/00 , H04N7/18 , G08G5/00 , H04R1/02 , H04R3/00 , H04N5/232 , H04N5/247
Abstract: In an object, for example, a pilotless flying object detection system, an omnidirectional camera as a first camera images a monitoring area. A microphone array acquires audio of the monitoring area. A monitoring apparatus uses the audio data acquired by the microphone array to detect a pilotless flying object which appears in the monitoring area. A signal processor in the monitoring apparatus superimposes a discrimination mark, obtained by converting the pilotless flying object into visual information, on image data of the monitoring area when displaying the image data of the monitoring area captured by the omnidirectional camera on a monitor.
-
公开(公告)号:US10397525B2
公开(公告)日:2019-08-27
申请号:US15454722
申请日:2017-03-09
Inventor: Hiroyuki Matsumoto , Shintaro Yoshikuni , Masanari Miyamoto
IPC: H04N7/18 , H04R29/00 , G10L21/10 , G01H9/00 , G01S5/20 , G06K9/00 , G08G5/00 , H04R3/00 , H04R1/40
Abstract: In a pilotless flying object detection system, a masking area setter sets a masking area to be excluded from detection of a pilotless flying object which appears in a captured image of a monitoring area, based on audio collected by a microphone array. An object detector detects the pilotless flying object based on the audio collected by the microphone array and the masking area set by the masking area setter. An output controller superimpose sound source visual information, which indicates the volume of a sound at a sound source position, at the sound source position of the pilotless flying object in the captured image and displays the result on a first monitor in a case where the pilotless flying object is detected in an area other than the masking area.
-
公开(公告)号:US20210142072A1
公开(公告)日:2021-05-13
申请号:US17154585
申请日:2021-01-21
Inventor: Hiroyuki Matsumoto , Toshimichi Tokuda , Shintaro Yoshikuni
Abstract: In a sound source display system, an omnidirectional camera captures an image of a monitoring area. A microphone array collects a voice in the monitoring area. A monitoring monitor displays the image of an imaging area captured by the omnidirectional camera. A sound pressure calculator in a directivity control device calculates a sound pressure indicating a source of a sound in the image of the imaging area using voice data of the voice collected by the microphone array. An output controller in the directivity control device compares the sound pressure and threshold values (first threshold value, second threshold value), and causes sound image information in which the sound pressure is converted into visual information according to the result of comparison, to be displayed on the monitoring monitor so as to be superimposed on the image of the imaging area.
-
公开(公告)号:US10244162B2
公开(公告)日:2019-03-26
申请号:US15830776
申请日:2017-12-04
Inventor: Hirotaka Sawa , Toshimichi Tokuda , Shinichi Shigenaga , Shuichi Watanabe , Shojiro Matsuo , Takashi Hirabara , Tadashi Maki , Hisashi Tsuji , Teppei Fukuda , Akitoshi Izumi , Shintaro Yoshikuni , Hiroyuki Matsumoto , Kazunori Hayashi , Kosuke Shinozaki
Abstract: A directionality control system includes: a camera; a microphone provided as a separate body from the camera; a display that displays video data captured by the camera; and a processor that computes a sound collection direction, which is directed from the microphone toward a sound position corresponding to a designated position in the video data. The processor computes the sound collection direction by using parameters including: a first height of the camera from a reference surface, a second height of the microphone from the reference surface, a third height of a computation reference point from the reference surface, the computation reference point being positioned in the sound collection direction at a position different from the sound position, a direction which is directed from the camera toward the sound position, and a fourth height of the sound position from the reference surface.
-
公开(公告)号:US10909384B2
公开(公告)日:2021-02-02
申请号:US15182488
申请日:2016-06-14
Inventor: Hiroyuki Matsumoto , Toshimichi Tokuda , Shintaro Yoshikuni
Abstract: In a sound source display system, an omnidirectional camera captures an image of a monitoring area. A microphone array collects a voice in the monitoring area. A monitoring monitor displays the image of an imaging area captured by the omnidirectional camera. A sound pressure calculator in a directivity control device calculates a sound pressure indicating a source of a sound in the image of the imaging area using voice data of the voice collected by the microphone array. An output controller in the directivity control device compares the sound pressure and threshold values (first threshold value, second threshold value), and causes sound image information in which the sound pressure is converted into visual information according to the result of comparison, to be displayed on the monitoring monitor so as to be superimposed on the image of the imaging area.
-
公开(公告)号:US20180160032A1
公开(公告)日:2018-06-07
申请号:US15830776
申请日:2017-12-04
Inventor: Hirotaka SAWA , Toshimichi Tokuda , Shinichi Shigenaga , Shuichi Watanabe , Shojiro Matsuo , Takashi Hirabara , Tadashi Maki , Hisashi Tsuji , Teppei Fukuda , Akitoshi Izumi , Shintaro Yoshikuni , Hiroyuki Matsumoto , Kazunori Hayashi , Kosuke Shinozaki
CPC classification number: H04N5/23216 , G01S3/785 , G01S3/7864 , H04N5/23293 , H04N5/23296 , H04R1/04 , H04R1/406 , H04R2201/401 , H04R2430/23 , H04S7/00 , H04S2420/01
Abstract: A directionality control system includes: a camera; a microphone provided as a separate body from the camera; a display that displays video data captured by the camera; and a processor that computes a sound collection direction, which is directed from the microphone toward a sound position corresponding to a designated position in the video data. The processor computes the sound collection direction by using parameters including: a first height of the camera from a reference surface, a second height of the microphone from the reference surface, a third height of a computation reference point from the reference surface, the computation reference point being positioned in the sound collection direction at a position different from the sound position, a direction which is directed from the camera toward the sound position, and a fourth height of the sound position from the reference surface.
-
公开(公告)号:US09747454B2
公开(公告)日:2017-08-29
申请号:US14311910
申请日:2014-06-23
Inventor: Shinichi Shigenaga , Hirotaka Sawa , Kazunori Hayashi , Toshimichi Tokuda , Shintaro Yoshikuni , Kosuke Shinozaki
IPC: H04R3/00 , G06F21/60 , G08B13/16 , G08B13/196
CPC classification number: G06F21/60 , G08B13/1672 , G08B13/19652 , G08B13/19686 , G08B13/19695 , H04R3/005 , H04R2201/401 , H04R2430/23
Abstract: A system includes an imaging part that captures an image, a sound collection part that collects sounds, a display part that displays image data captured by the imaging part, a directive direction calculation part that calculates a directive direction which directs toward a sound position corresponding to a designated position of the image data from the sound collection part when any position of the displayed image data is designated, and a control part that forms a directivity in the sounds in the calculated directive direction. The control part controls output of the sounds collected by the sound collection part or output of the sounds which are collected by the sound collection part and of which the directivity is formed, or suspends collection of sounds in the sound collection part, when it is determined that the sound position is included in a preset protection region.
-
公开(公告)号:US09635481B2
公开(公告)日:2017-04-25
申请号:US14809354
申请日:2015-07-27
Inventor: Hiroyuki Matsumoto , Shuichi Watanabe , Toshimichi Tokuda , Hisashi Tsuji , Akitoshi Izumi , Shintaro Yoshikuni
IPC: H04R29/00
CPC classification number: H04R29/004
Abstract: A failure detection system includes an omnidirectional microphone array device having a plurality of microphone elements and a directivity control device that calculates a delay time of a voice propagated from a sound source to each microphone element and forms a directivity of the voice using the delay time and the voice collected by the omnidirectional microphone array device, and detects a failure of the microphone element. A smoothing unit calculates an average power of one microphone element. An average calculator calculates a total average power of a plurality of usable microphone elements included in the omnidirectional microphone array device. A comparison unit compares whether or not a difference between the average power and the total average power exceeds a range of ±6 dB, and determines whether the microphone element is in failure based on the comparison result.
-
-
-
-
-
-
-
-
-