Automatic generation of video and directional audio from spherical content

    公开(公告)号:US10679676B2

    公开(公告)日:2020-06-09

    申请号:US16721561

    申请日:2019-12-19

    Applicant: GoPro, Inc.

    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

    Automatic generation of video and directional audio from spherical content

    公开(公告)号:US10573351B2

    公开(公告)日:2020-02-25

    申请号:US16456673

    申请日:2019-06-28

    Applicant: GoPro, Inc.

    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

    BEAM FORMING FOR MICROPHONES ON SEPARATE FACES OF A CAMERA

    公开(公告)号:US20200021771A1

    公开(公告)日:2020-01-16

    申请号:US16550566

    申请日:2019-08-26

    Applicant: GoPro, Inc.

    Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.

    Beam forming for microphones on separate faces of a camera

    公开(公告)号:US10425610B2

    公开(公告)日:2019-09-24

    申请号:US16154079

    申请日:2018-10-08

    Applicant: GoPro, Inc.

    Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.

    AUTOMATICALLY DETERMINING A WET MICROPHONE CONDITION IN A SPORTS CAMERA
    28.
    发明申请
    AUTOMATICALLY DETERMINING A WET MICROPHONE CONDITION IN A SPORTS CAMERA 有权
    在运动相机中自动确定湿度麦克风条件

    公开(公告)号:US20170006398A1

    公开(公告)日:2017-01-05

    申请号:US15083266

    申请日:2016-03-28

    Applicant: GoPro, Inc.

    Inventor: Zhinian Jing Ke Li

    Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.

    Abstract translation: 用于运动照相机的音频捕获系统包括至少一个“增强”麦克风和至少一个“参考”麦克风。 增强型麦克风包括排水增强功能,使得水能够比参考麦克风更快地从麦克风中排出。 麦克风选择控制器基于麦克风选择算法在麦克风之间进行选择,以在诸如冲浪,滑水,游泳或其它湿润环境的活动期间在运动相机转入和移出水的条件下实现高质量。

    Audio encoder for wind and microphone noise reduction in a microphone array system
    29.
    发明授权
    Audio encoder for wind and microphone noise reduction in a microphone array system 有权
    麦克风阵列系统中用于风和麦克风降噪的音频编码器

    公开(公告)号:US09460727B1

    公开(公告)日:2016-10-04

    申请号:US14789683

    申请日:2015-07-01

    Applicant: GoPro, Inc.

    Abstract: An audio system encodes and decodes audio captured by a microphone array system in the presence of wind noise. The encoder encodes the audio signal in a way that includes beamformed audio signal and a “hidden” representation of a non-beamformed audio signal. The hidden signal is produced by modulating the low frequency signal to a high frequency above the audible range. A decoder can then either output the beamformed audio signal or can use the hidden signal to generate a reduced wind noise audio signal that includes the non-beamformed audio in the low frequency range.

    Abstract translation: 音频系统在存在风噪声的情况下对由麦克风阵列系统捕获的音频进行编码和解码。 编码器以包括波束形成的音频信号和非波束形成的音频信号的“隐藏”表示的方式对音频信号进行编码。 通过将低频信号调制到高于可听范围的高频产生隐藏信号。 然后,解码器可以输出波束形成的音频信号,或者可以使用隐藏信号来产生包括低频范围内的非波束成形音频的降低的风噪声音频信号。

    AUTOMATIC GENERATION OF VIDEO AND DIRECTIONAL AUDIO FROM SPHERICAL CONTENT

    公开(公告)号:US20200135238A1

    公开(公告)日:2020-04-30

    申请号:US16721561

    申请日:2019-12-19

    Applicant: GoPro, Inc.

    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

Patent Agency Ranking