公开(公告)号：US10362199B2

公开(公告)日：2019-07-23

申请号：US15674355

申请日：2017-08-10

Applicant: GoPro, Inc.

Inventor： Zhinian Jing ,  Ke Li ,  Erich Tisch ,  Joyce Rosenbaum ,  Magnus Hansson

IPC: H04R25/00 ,  H04R29/00 ,  H04R3/00 ,  H04N5/225 ,  G03B17/08 ,  H04R1/44 ,  H04R5/04

Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.

公开(公告)号：US20190052835A1

公开(公告)日：2019-02-14

申请号：US16154079

申请日：2018-10-08

Applicant: GoPro, Inc.

Inventor： Zhinian Jing ,  Joyce Rosenbaum

IPC: H04N5/60 ,  H04R5/027 ,  H04S7/00 ,  H04N5/225

CPC classification number: H04N5/607 ,  H04N5/225 ,  H04N5/232 ,  H04N5/23264 ,  H04R5/027 ,  H04R2203/12 ,  H04R2499/11 ,  H04S7/305 ,  H04S2400/15

Abstract: A camera system capable of capturing images of an event in a dynamic environment includes two microphones configured to capture stereo audio of the event. The microphones are on orthogonal surfaces of the camera system. Because the microphones are on orthogonal surfaces of the camera system, the camera body can impact the spatial response of the two recorded audio channels differently, leading to degraded stereo recreation if standard beam forming techniques are used. The camera system includes tuned beam forming techniques to generate multi-channel audio that more accurately recreates the stereo audio by compensating for the shape of the camera system and the orientation of microphones on the camera system. The tuned beam forming techniques include optimizing a set of beam forming parameters, as a function of frequency, based on the true spatial response of the recorded audio signals.

公开(公告)号：US10056115B2

公开(公告)日：2018-08-21

申请号：US15396385

申请日：2016-12-30

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Zhinian Jing ,  Timothy Macmillan ,  David A. Newman ,  Balineedu Chowdary Adsumilli

IPC: G11B27/30 ,  H04N5/232 ,  H04N9/806 ,  H04N9/82

CPC classification number: G11B27/3081 ,  H04N5/23238 ,  H04N5/77 ,  H04N9/806 ,  H04N9/8205 ,  H04N9/8211

Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

公开(公告)号：US20170111627A1

公开(公告)日：2017-04-20

申请号：US15395986

申请日：2016-12-30

Applicant: GoPro, Inc.

Inventor： Paul Beckmann ,  Erich Tisch ,  Zhinian Jing

IPC: H04N9/802 ,  G10L21/0264 ,  H04R3/00 ,  G10L21/0216 ,  H04N9/79

CPC classification number: H04N9/802 ,  G10L21/0216 ,  G10L21/0264 ,  G10L2021/02166 ,  H04N1/2125 ,  H04N9/7908 ,  H04R3/005 ,  H04R2499/11

Abstract: A camera system includes a first microphone, a second microphone, and a microphone controller. The first microphone and the second microphone are configured to capture audio over a time interval to produce a first captured audio signal and a second captured audio signal, respectively. The second captured audio signal is dampened relative to the first captured audio signal by a dampening factor. The microphone controller is configured to store the first captured audio signal in response to a determination that the first captured audio signal does not clip. In response to a determination that the first captured audio signal clips, the microphone controller is configured to identify a gain between the first captured audio signal and the second captured audio signal representative of the dampening factor, amplify the second captured audio signal based on the identified gain, and store the amplified second captured audio signal.

公开(公告)号：US20170110155A1

公开(公告)日：2017-04-20

申请号：US15396385

申请日：2016-12-30

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Zhinian Jing ,  Timothy Macmillan ,  David A. Newman ,  Balineedu Chowdary Adsumilli

IPC: G11B27/30 ,  H04N9/806 ,  H04N9/82 ,  H04N5/232

CPC classification number: G11B27/3081 ,  H04N5/23238 ,  H04N5/77 ,  H04N9/806 ,  H04N9/8205 ,  H04N9/8211

Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

公开(公告)号：US20170006397A1

公开(公告)日：2017-01-05

申请号：US15083264

申请日：2016-03-28

Applicant: GoPro, Inc.

Inventor： Zhinian Jing ,  Erich Tisch ,  Ke Li ,  Joyce Rosenbaum ,  Magnus Hansson

IPC: H04R29/00 ,  H04R3/00 ,  H04R1/44

CPC classification number: H04N5/2252 ,  G03B17/08 ,  H04R1/44 ,  H04R3/00 ,  H04R3/005 ,  H04R5/04 ,  H04R29/004 ,  H04R2410/05 ,  H04R2410/07 ,  H04R2499/11

Abstract: An audio capture system for a sports camera includes at least one “enhanced” microphone and at least one “reference” microphone. The enhanced microphone includes a drainage enhancement feature to enable water to drain from the microphone more quickly than the reference microphone. A microphone selection controller selects between the microphones based on a microphone selection algorithm to enable high quality in conditions where the sports camera transitions in and out of water during activities such as surfing, water skiing, swimming, or other wet environments.

Abstract translation: 用于运动照相机的音频捕获系统包括至少一个“增强”麦克风和至少一个“参考”麦克风。 增强型麦克风包括排水增强功能，使得水能够比参考麦克风更快地从麦克风中排出。 麦克风选择控制器基于麦克风选择算法在麦克风之间进行选择，以在诸如冲浪，滑水，游泳或其它湿润环境的活动期间在运动相机转入和移出水的条件下实现高质量。

公开(公告)号：US20160241832A1

公开(公告)日：2016-08-18

申请号：US15140260

申请日：2016-04-27

Applicant: GoPro, Inc.

Inventor： Paul Beckmann ,  Erich Tisch ,  Zhinian Jing

IPC: H04N9/802 ,  H04R3/00 ,  G10L21/0216 ,  H04N9/79 ,  G10L21/0264

CPC classification number: H04N9/802 ,  G10L21/0216 ,  G10L21/0264 ,  G10L2021/02166 ,  H04N1/2125 ,  H04N9/7908 ,  H04R3/005 ,  H04R2499/11

Abstract: A camera system includes a first microphone, a second microphone, and a microphone controller. The first microphone and the second microphone are configured to capture audio over a time interval to produce a first captured audio signal and a second captured audio signal, respectively. The second captured audio signal is dampened relative to the first captured audio signal by a dampening factor. The microphone controller is configured to store the first captured audio signal in response to a determination that the first captured audio signal does not clip. In response to a determination that the first captured audio signal clips, the microphone controller is configured to identify a gain between the first captured audio signal and the second captured audio signal representative of the dampening factor, amplify the second captured audio signal based on the identified gain, and store the amplified second captured audio signal.

Abstract translation: 相机系统包括第一麦克风，第二麦克风和麦克风控制器。 第一麦克风和第二麦克风被配置为在一段时间间隔内捕获音频以分别产生第一捕获音频信号和第二捕获音频信号。 第二捕获的音频信号相对于第一捕获的音频信号被阻尼因子衰减。 麦克风控制器被配置为响应于确定第一捕获的音频信号不被剪切而存储第一捕获的音频信号。 响应于确定第一捕获的音频信号剪辑，麦克风控制器被配置为识别代表衰减因子的第一捕获音频信号和第二捕获音频信号之间的增益，基于所识别的音频信号放大第二捕获音频信号 增益并存储放大的第二捕获音频信号。

公开(公告)号：US20160005435A1

公开(公告)日：2016-01-07

申请号：US14789706

申请日：2015-07-01

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Zhinian Jing ,  Timothy MacMillan ,  David A. Newman ,  Balineedu Chowdary Adsumilli

IPC: G11B27/031 ,  G11B27/30 ,  H04N5/232 ,  H04N9/802 ,  H04N5/77

CPC classification number: G11B27/3081 ,  H04N5/23238 ,  H04N5/77 ,  H04N9/806 ,  H04N9/8205 ,  H04N9/8211

Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

Abstract translation: 球面内容捕获系统捕获球面视频和音频内容。 在一个实施例中，捕获的元数据或视频/音频处理被用于基于时间和位置信息来识别与特定用户相关的内容。 然后，平台可以从与用户相关的一个或多个共享球面内容文件生成输出视频。 输出视频可以包括诸如通常与常规相机系统相关联的非球面缩小视场。 特别地，可以从球面视频的每个帧中提取具有减小的视场的相关子帧，以生成跟踪特定个人或感兴趣对象的输出视频。 对于每个子帧，生成音频轨道的对应部分，其包括具有基于所选择的子帧的方向性的定向音频信号。