Apparatus and methods for multi-resolution image stitching

    公开(公告)号:US11475538B2

    公开(公告)日:2022-10-18

    申请号:US17314217

    申请日:2021-05-07

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions. The stitched image may be encoded using selective encoding methodology including: partitioning source images into a low resolution/frequency and a high resolution/frequency components; stitching low resolution/frequency components using coarse stitching operation, stitching high resolution/high frequency components using a refined stitch operation; combining stitched LF components and stitched HF components.

    Systems, methods and apparatus for compressing video content

    公开(公告)号:US11228749B2

    公开(公告)日:2022-01-18

    申请号:US16866447

    申请日:2020-05-04

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for characterizing panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube or any other projection e.g icosahedron or octahedron. The disclosure exploits content continuity between facets, such as in the case of encoding/decoding cube-projected images. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained; e.g., one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remaining facets of the cube may be encoded using transformed versions within the augmented image. Continuity between transformed facets in the top row of the augmented image and facets in the middle row of the augmented image may be utilized for motion or intra prediction, and to obtain greater encoding performance compared to encoding facets independently.

    SYSTEMS AND METHODS FOR MODIFYING IMAGE DISTORTION (CURVATURE) FOR VIEWING DISTANCE IN POST CAPTURE

    公开(公告)号:US20210042877A1

    公开(公告)日:2021-02-11

    申请号:US17079404

    申请日:2020-10-23

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for modifying image distortion (curvature) for viewing distance in post capture. Presentation of imaging content on a content display device may be characterized by a presentation field of view (FOV). Presentation FOV may be configured based on screen dimensions of the display device and distance between the viewer and the screen. Imaging content may be obtained by an activity capture device characterized by a wide capture field of view lens (e.g., fish-eye). Images may be transformed into rectilinear representation for viewing. When viewing images using presentation FOV that may narrower than capture FOV, transformed rectilinear images may appear distorted. A transformation operation may be configured to account for presentation FOV—capture FOV mismatch. In some implementations, the transformation may include fish-eye to rectilinear transformation characterized by a transformation strength that may be configured based on a ratio of the presentation FOV to the capture FOV.

    Automatic generation of video and directional audio from spherical content

    公开(公告)号:US10679676B2

    公开(公告)日:2020-06-09

    申请号:US16721561

    申请日:2019-12-19

    Applicant: GoPro, Inc.

    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

    Apparatus and methods for video compression using multi-resolution scalable coding

    公开(公告)号:US10652558B2

    公开(公告)日:2020-05-12

    申请号:US16234214

    申请日:2018-12-27

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.

    SYSTEMS AND METHODS FOR COMPRESSING VIDEO CONTENT

    公开(公告)号:US20200084394A1

    公开(公告)日:2020-03-12

    申请号:US16687559

    申请日:2019-11-18

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for providing imaging content using spatially varying encoding quality. Imaging content may be acquired using spherical lenses (e.g., fisheye). When viewing spherical imaging content, spherical to planar image transformations may be utilized. Such transformations (e.g., equirectangular) may be characterized by spatially varying image distortion. Transformed images may be encoded. Encoding process may be configured based on spatially varying encoding quality. Encoding quality may be configured based on the transformation such that portions of the transformed image characterized by greater distortion may be encoded using lower quality (e.g. greater QP values); portions of the transformed image characterized by lower distortion may be encoded using greater quality (e.g. lower QP values). Such encoding may produce a bitstream characterized by a lower bitrate for a given quality and/or better quality for a given bitrate as compared to an encoding process that may apply a uniform encoding quality.

    Automatic generation of video and directional audio from spherical content

    公开(公告)号:US10573351B2

    公开(公告)日:2020-02-25

    申请号:US16456673

    申请日:2019-06-28

    Applicant: GoPro, Inc.

    Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

    Systems and methods for compressing video content

    公开(公告)号:US10484621B2

    公开(公告)日:2019-11-19

    申请号:US15414403

    申请日:2017-01-24

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for providing imaging content using spatially varying encoding quality. Imaging content may be acquired using spherical lenses (e.g., fisheye). When viewing spherical imaging content, spherical to planar image transformations may be utilized. Such transformations (e.g., equirectangular) may be characterized by spatially varying image distortion. Transformed images may be encoded. Encoding process may be configured based on spatially varying encoding quality. Encoding quality may be configured based on the transformation such that portions of the transformed image characterized by greater distortion may be encoded using lower quality (e.g. greater QP values); portions of the transformed image characterized by lower distortion may be encoded using greater quality (e.g. lower QP values). Such encoding may produce a bitstream characterized by a lower bitrate for a given quality and/or better quality for a given bitrate as compared to an encoding process that may apply a uniform encoding quality.

Patent Agency Ranking