Image alignment using a virtual gyroscope model

    公开(公告)号:US11503209B2

    公开(公告)日:2022-11-15

    申请号:US16538641

    申请日:2019-08-12

    Applicant: GoPro, Inc.

    Abstract: A target image captured from a fisheye lens or other lens with known distortion parameters may be transformed to align it to a reference image. Corresponding features may be detected in the target image and the reference image. The features may be transformed to a spherical coordinate space. In the spherical space, images may be re-pointed or rotated in three dimensions to align all or a subset of the features of the target image to the corresponding features of the reference image. For example, in a sequence of images, background features of the target image in the spherical image space may be aligned to background features of the reference image in the spherical image space to compensate for camera motion while preserving foreground motion. An inverse transformation may then be applied to bring the images back into the original image space.

    SYSTEMS AND METHODS FOR SPATIALLY SELECTIVE VIDEO CODING

    公开(公告)号:US20210344927A1

    公开(公告)日:2021-11-04

    申请号:US17378065

    申请日:2021-07-16

    Applicant: GoPro, Inc.

    Abstract: A method for encoding images includes decoding a first encoded image to obtain a first decoded image, where the first decoded image includes a first decoded portion corresponding to a first encoded portion of the first encoded image and a second decoded portion corresponding to a second encoded portion of the first encoded image; decoding a second encoded image to obtain a second decoded image; combining the first decoded image and the second decoded image to obtain a single decoded image; and encoding the single decoded image to obtain a single encoded image that includes a third and a fourth encoded portions. Encoding the single decoded image includes obtaining the third encoded portion of the single encoded image by copying the first encoded portion of the first encoded image; and obtaining the fourth encoded portion of the single encoded image by encoding the second decoded portion using an encoder.

    Systems and methods for spatially selective video coding

    公开(公告)号:US11122271B2

    公开(公告)日:2021-09-14

    申请号:US16666094

    申请日:2019-10-28

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for providing panoramic image and/or video content using spatially selective encoding and/or decoding. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, selective encoding functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. Encoded source images may be decoded and stitched in order to obtain a combined image characterized by a greater field of view as compared to source images. The stitched image may be encoded using a selective encoding methodology including: partitioning a stitched image into multiple portions, determining if a portion is to be re-encoded. If the image portion is to be re-encoded, re-encoding the image portion. If an image portion is not to be re-encoded, copying previously encoded image portion in lieu of encoding.

    Image stitching in a multi-camera array

    公开(公告)号:US11064116B2

    公开(公告)日:2021-07-13

    申请号:US16505542

    申请日:2019-07-08

    Applicant: GoPro, Inc.

    Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.

    Apparatus and methods for multi-resolution image stitching

    公开(公告)号:US11030717B2

    公开(公告)日:2021-06-08

    申请号:US16656396

    申请日:2019-10-17

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions. The stitched image may be encoded using selective encoding methodology including: partitioning source images into a low resolution/frequency and a high resolution/frequency components; stitching low resolution/frequency components using coarse stitching operation, stitching high resolution/high frequency components using a refined stitch operation; combining stitched LF components and stitched HF components.

    Systems and methods for spatially adaptive video encoding

    公开(公告)号:US10827176B2

    公开(公告)日:2020-11-03

    申请号:US16410919

    申请日:2019-05-13

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for providing video content using spatially adaptive video encoding. Panoramic and/or virtual reality content may be viewed by a client device using a viewport with viewing dimension(s) configured smaller than available dimension(s) of the content. Client device may include a portable media device characterized by given energy and/or computational resources. Video content may be encoded using spatially varying encoding. For image playback, portions of panoramic image may be pre-encoded using multiple quality bands. Pre-encoded image portions, matching the viewport, may be provided and reduce computational and/or energy load on the client device during consumption of panoramic content. Quality distribution may include gradual quality transition area allowing for small movements of the viewport without triggering image re-encoding. Larger movements of the viewport may automatically trigger transition to another spatial encoding distribution.

Patent Agency Ranking