Apparatus and methods for the selection of one or more frame interpolation techniques

    公开(公告)号:US10057538B2

    公开(公告)日:2018-08-21

    申请号:US15407089

    申请日:2017-01-16

    Applicant: GoPro, Inc.

    CPC classification number: H04N7/014 H04N11/20

    Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data; performing Lagrangian interpolation on one or more portions of the obtained two or more frames of video data to generate a Lagrangian interpolated image; performing Eulerian interpolation on one or more portions of the obtained two or more frames to generate a Eulerian interpolated image; and when the Lagrangian interpolated image and the Eulerian interpolated image should be combined, computing an average interpolated image using the Lagrangian interpolated image and the Eulerian interpolated image; otherwise, selecting either the Lagrangian interpolated image or the Eulerian interpolated image; and generating an interpolated frame of video data using one or more of the average interpolated image, the Lagrangian interpolated image, or the Eulerian interpolated image.

    Apparatus and methods for video image post-processing for segmentation-based interpolation

    公开(公告)号:US10134114B2

    公开(公告)日:2018-11-20

    申请号:US15270971

    申请日:2016-09-20

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for video image post-processing for segmentation based interpolation. In one embodiment, a computerized apparatus is utilized in order to obtain a first frame of video data; segment one or more objects within the first frame of video data; obtain a second frame of video data; segment one or more objects within the second frame of video data; match at least a portion of the one or more objects within the first frame of video data with the one or more objects within the second frame of video data; compute the motion of the pixels for the matched portion of the one or more objects; compute the motion of pixels associated with a background image; and generate an interpolated frame of video data, the interpolated frame of video data residing temporally between the first frame of video data and the second frame of video data.

    APPARATUS AND METHODS FOR VIDEO IMAGE POST-PROCESSING FOR SEGMENTATION-BASED INTERPOLATION

    公开(公告)号:US20180082404A1

    公开(公告)日:2018-03-22

    申请号:US15270971

    申请日:2016-09-20

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for video image post-processing for segmentation based interpolation. In one embodiment, a computerized apparatus is utilized in order to obtain a first frame of video data; segment one or more objects within the first frame of video data; obtain a second frame of video data; segment one or more objects within the second frame of video data; match at least a portion of the one or more objects within the first frame of video data with the one or more objects within the second frame of video data; compute the motion of the pixels for the matched portion of the one or more objects; compute the motion of pixels associated with a background image; and generate an interpolated frame of video data, the interpolated frame of video data residing temporally between the first frame of video data and the second frame of video data.

    APPARATUS AND METHODS FOR THE SELECTION OF ONE OR MORE FRAME INTERPOLATION TECHNIQUES

    公开(公告)号:US20180205909A1

    公开(公告)日:2018-07-19

    申请号:US15407089

    申请日:2017-01-16

    Applicant: GoPro, Inc.

    CPC classification number: H04N7/014 G06T3/40 H04N11/20

    Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data; performing Lagrangian interpolation on one or more portions of the obtained two or more frames of video data to generate a Lagrangian interpolated image; performing Eulerian interpolation on one or more portions of the obtained two or more frames to generate a Eulerian interpolated image; and when the Lagrangian interpolated image and the Eulerian interpolated image should be combined, computing an average interpolated image using the Lagrangian interpolated image and the Eulerian interpolated image; otherwise, selecting either the Lagrangian interpolated image or the Eulerian interpolated image; and generating an interpolated frame of video data using one or more of the average interpolated image, the Lagrangian interpolated image, or the Eulerian interpolated image.

    APPARATUS AND METHODS FOR FRAME INTERPOLATION

    公开(公告)号:US20180063551A1

    公开(公告)日:2018-03-01

    申请号:US15251980

    申请日:2016-08-30

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for generating interpolated frames in digital image or video data. In one embodiment, the interpolation is based on a hierarchical tree sequence. At each level of the tree, an interpolated frame may be generated using original or interpolated frames of the video, such as those closest in time to the desired time of the frame to be generated. The sequence proceeds through lower tree levels until a desired number of interpolated frames, a desired video length, a desired level, or a desired visual quality for the video is reached. In some implementations, the sequence may use different interpolation algorithms (e.g., of varying computational complexity or types) at different levels of the tree. The interpolation algorithms can include for example those based on frame repetition, frame averaging, motion compensated frame interpolation, and motion blending.

Patent Agency Ranking