Combining independent solutions to an image or video processing task

    公开(公告)号:US10824911B2

    公开(公告)日:2020-11-03

    申请号:US15973184

    申请日:2018-05-07

    申请人: GoPro, Inc.

    摘要: An algorithm for performing an image or video processing task is generated that may be used to combine a plurality of different independent solutions to the image or video processing task in an optimized manner. A plurality of base algorithms may be applied to a training set of images or video and a first generation of different combining algorithms may be applied to combine the respective solutions from each of the respective base algorithms into respective combined solutions. The respective combined solutions may be evaluated to generate respective fitness scores representing measures of how well the plurality of different combining algorithms each perform the image or video processing task. The algorithms may be iteratively updated to generate an optimized combining algorithm that may be applied to an input image or video.

    Apparatus and methods for the selection of one or more frame interpolation techniques

    公开(公告)号:US10057538B2

    公开(公告)日:2018-08-21

    申请号:US15407089

    申请日:2017-01-16

    申请人: GoPro, Inc.

    IPC分类号: H04N7/01 H04N11/20

    CPC分类号: H04N7/014 H04N11/20

    摘要: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data; performing Lagrangian interpolation on one or more portions of the obtained two or more frames of video data to generate a Lagrangian interpolated image; performing Eulerian interpolation on one or more portions of the obtained two or more frames to generate a Eulerian interpolated image; and when the Lagrangian interpolated image and the Eulerian interpolated image should be combined, computing an average interpolated image using the Lagrangian interpolated image and the Eulerian interpolated image; otherwise, selecting either the Lagrangian interpolated image or the Eulerian interpolated image; and generating an interpolated frame of video data using one or more of the average interpolated image, the Lagrangian interpolated image, or the Eulerian interpolated image.

    Apparatus and methods for frame interpolation based on spatial considerations

    公开(公告)号:US10003768B2

    公开(公告)日:2018-06-19

    申请号:US15278976

    申请日:2016-09-28

    申请人: GoPro, Inc.

    IPC分类号: H04N7/01

    摘要: Apparatus and methods for the generation of interpolated frames of video data. In one embodiment, a computerized apparatus is disclosed that includes a video data interface configured to receive frames of video data; a processing apparatus in data communication with the video data interface; and a storage apparatus in data communication with the processing apparatus. The computerized apparatus is further configured to: receive frames of captured video data; retrieve capture parameters associated with the frames of captured video data; generate optical flow parameters from the frames of captured video data; ascribe differing weights based on the capture parameters and/or the optical flow parameters; generate frames of interpolated video data for the frames of captured video data based at least in part on the ascribed weights; and compile a resultant video stream using the frames of interpolated video data and the frames of captured video data.

    Image alignment using a virtual gyroscope model

    公开(公告)号:US11503209B2

    公开(公告)日:2022-11-15

    申请号:US16538641

    申请日:2019-08-12

    申请人: GoPro, Inc.

    IPC分类号: H04N5/232

    摘要: A target image captured from a fisheye lens or other lens with known distortion parameters may be transformed to align it to a reference image. Corresponding features may be detected in the target image and the reference image. The features may be transformed to a spherical coordinate space. In the spherical space, images may be re-pointed or rotated in three dimensions to align all or a subset of the features of the target image to the corresponding features of the reference image. For example, in a sequence of images, background features of the target image in the spherical image space may be aligned to background features of the reference image in the spherical image space to compensate for camera motion while preserving foreground motion. An inverse transformation may then be applied to bring the images back into the original image space.

    Image alignment using a virtual gyroscope model

    公开(公告)号:US10382683B2

    公开(公告)日:2019-08-13

    申请号:US15967364

    申请日:2018-04-30

    申请人: GoPro, Inc.

    IPC分类号: H04N5/232

    摘要: A target image captured from a fisheye lens or other lens with known distortion parameters may be transformed to align it to a reference image. Corresponding features may be detected in the target image and the reference image. The features may be transformed to a spherical coordinate space. In the spherical space, images may be re-pointed or rotated in three dimensions to align all or a subset of the features of the target image to the corresponding features of the reference image. For example, in a sequence of images, background features of the target image in the spherical image space may be aligned to background features of the reference image in the spherical image space to compensate for camera motion while preserving foreground motion. An inverse transformation may then be applied to bring the images back into the original image space.

    User interface for creating composite images

    公开(公告)号:US10129464B1

    公开(公告)日:2018-11-13

    申请号:US15436639

    申请日:2017-02-17

    申请人: GOPRO, INC.

    IPC分类号: H04N5/232

    摘要: Systems and methods for image compositing. Image capture devices may be used for documenting various activities. An image capture device may be configured to operate in image acquisition mode configured for image compositing. The image acquisition mode may be characterized by one or more of a given image acquisition interval, number of acquired images, camera shutter setting, and/or other settings. The image capture device may provide a user interface configured to facilitate acquiring an image sequence suitable for compositing. A live compositing preview may enable users to select one or more composite images for viewing and/or sharing.