Combining independent solutions to an image or video processing task

    公开(公告)号:US10824911B2

    公开(公告)日:2020-11-03

    申请号:US15973184

    申请日:2018-05-07

    Applicant: GoPro, Inc.

    Abstract: An algorithm for performing an image or video processing task is generated that may be used to combine a plurality of different independent solutions to the image or video processing task in an optimized manner. A plurality of base algorithms may be applied to a training set of images or video and a first generation of different combining algorithms may be applied to combine the respective solutions from each of the respective base algorithms into respective combined solutions. The respective combined solutions may be evaluated to generate respective fitness scores representing measures of how well the plurality of different combining algorithms each perform the image or video processing task. The algorithms may be iteratively updated to generate an optimized combining algorithm that may be applied to an input image or video.

    IMAGE STITCHING IN A MULTI-CAMERA ARRAY
    5.
    发明申请

    公开(公告)号:US20190387167A1

    公开(公告)日:2019-12-19

    申请号:US16505542

    申请日:2019-07-08

    Applicant: GoPro, Inc.

    Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.

    Systems and methods for multi-resolution image stitching

    公开(公告)号:US10482574B2

    公开(公告)日:2019-11-19

    申请号:US15643123

    申请日:2017-07-06

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions. The stitched image may be encoded using selective encoding methodology including: partitioning source images into a low resolution/frequency and a high resolution/frequency components; stitching low resolution/frequency components using coarse stitching operation, stitching high resolution/high frequency components using a refined stitch operation; combining stitched LF components and stitched HF components.

    Systems and methods for spatially adaptive video encoding

    公开(公告)号:US10291910B2

    公开(公告)日:2019-05-14

    申请号:US15334213

    申请日:2016-10-25

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for providing video content using spatially adaptive video encoding. Panoramic and/or virtual reality content may be viewed by a client device using a viewport with viewing dimension(s) configured smaller than available dimension(s) of the content. Client device may include a portable media device characterized by given energy and/or computational resources. Video content may be encoded using spatially varying encoding. For image playback, portions of panoramic image may be pre-encoded using multiple quality bands. Pre-encoded image portions, matching the viewport, may be provided and reduce computational and/or energy load on the client device during consumption of panoramic content. Quality distribution may include gradual quality transition area allowing for small movements of the viewport without triggering image re-encoding. Larger movements of the viewport may automatically trigger transition to another spatial encoding distribution.

    Upscaling and downscaling in a camera architecture

    公开(公告)号:US10096082B2

    公开(公告)日:2018-10-09

    申请号:US15727568

    申请日:2017-10-07

    Applicant: GoPro, Inc.

    Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

    Apparatus and methods for frame interpolation based on spatial considerations

    公开(公告)号:US10003768B2

    公开(公告)日:2018-06-19

    申请号:US15278976

    申请日:2016-09-28

    Applicant: GoPro, Inc.

    CPC classification number: H04N7/0137 G06T3/40 H04N7/0127 H04N7/014

    Abstract: Apparatus and methods for the generation of interpolated frames of video data. In one embodiment, a computerized apparatus is disclosed that includes a video data interface configured to receive frames of video data; a processing apparatus in data communication with the video data interface; and a storage apparatus in data communication with the processing apparatus. The computerized apparatus is further configured to: receive frames of captured video data; retrieve capture parameters associated with the frames of captured video data; generate optical flow parameters from the frames of captured video data; ascribe differing weights based on the capture parameters and/or the optical flow parameters; generate frames of interpolated video data for the frames of captured video data based at least in part on the ascribed weights; and compile a resultant video stream using the frames of interpolated video data and the frames of captured video data.

Patent Agency Ranking