AUTOMATIC GENERATION OF VIDEO AND DIRECTIONAL AUDIO FROM SPHERICAL CONTENT

    公开(公告)号:US20190325915A1

    公开(公告)日:2019-10-24

    申请号:US16456673

    申请日:2019-06-28

    Applicant: GoPro, Inc.

    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

    APPARATUS AND METHODS FOR THE STORAGE OF OVERLAPPING REGIONS OF IMAGING DATA FOR THE GENERATION OF OPTIMIZED STITCHED IMAGES

    公开(公告)号:US20190289223A1

    公开(公告)日:2019-09-19

    申请号:US16234330

    申请日:2018-12-27

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

    Automatic generation of video and directional audio from spherical content

    公开(公告)号:US10410680B2

    公开(公告)日:2019-09-10

    申请号:US16105304

    申请日:2018-08-20

    Applicant: GoPro, Inc.

    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

    Apparatus and methods for the storage of overlapping regions of imaging data for the generation of optimized stitched images

    公开(公告)号:US10194097B2

    公开(公告)日:2019-01-29

    申请号:US15406175

    申请日:2017-01-13

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

    Associating audio with three-dimensional objects in videos

    公开(公告)号:US10045120B2

    公开(公告)日:2018-08-07

    申请号:US15187695

    申请日:2016-06-20

    Applicant: GoPro, Inc.

    Abstract: Disclosed is a system and method for generating a model of the geometric relationships between various audio sources recorded by a multi-camera system. The spatial audio scene module associates source signals, extracted from recorded audio, of audio sources to visual objects identified in videos recorded by one or more cameras. This association may be based on estimated positions of the audio sources based on relative signal gains and delays of the source signal received at each microphone. The estimated positions of audio sources are tracked indirectly by tracking the associated visual objects with computer vision. A virtual microphone module may receive a position for a virtual microphone and synthesize a signal corresponding to the virtual microphone position based on the estimated positions of the audio sources.

    Multi camera mount
    58.
    发明授权

    公开(公告)号:US09851623B2

    公开(公告)日:2017-12-26

    申请号:US15164785

    申请日:2016-05-25

    Applicant: GoPro, Inc.

    CPC classification number: G03B17/561 G03B37/04

    Abstract: A camera mounting assembly is disclosed for a plurality of cameras. In an example embodiment, the camera mounting assembly has a substantially cubic configuration. The camera mounting assembly includes a cubic configuration that includes one or more detachable frames. Each frame is attached to one or more other detachable frames via a securing mechanism to form the cube structure. Each frame includes one or more arms connected to a lens opening, the lens opening configured to allow a lens of the camera to have an unobstructed view for capturing images. A camera is secured to each frame by a standoff. A first end of the standoff attaches to a corner of the frame and the second end is attached to the camera. A box structure that houses electronics is located at the center of the cubic configuration and the box structure is secured to one or more frames via standoffs.

    APPARATUS AND METHODS FOR THE OPTIMAL STITCH ZONE CALCULATION OF A GENERATED PROJECTION OF A SPHERICAL IMAGE

    公开(公告)号:US20230027366A1

    公开(公告)日:2023-01-26

    申请号:US17960040

    申请日:2022-10-04

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.

Patent Agency Ranking