-
1.
公开(公告)号:US11151704B2
公开(公告)日:2021-10-19
申请号:US16692280
申请日:2019-11-22
Applicant: GoPro, Inc.
Inventor: Aaron Staranowicz , Ryan Lustig , Desmond Chik
Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data from a video sequence; determining frame errors for the obtained two or more frames from the video sequence, determining whether the frame errors exceed a threshold value; performing a multi-pass operation; performing a single-pass operation; performing frame blending; performing edge correction; and generating the interpolated frame of image data.
-
2.
公开(公告)号:US20180315174A1
公开(公告)日:2018-11-01
申请号:US15583794
申请日:2017-05-01
Applicant: GOPRO, INC.
Inventor: Aaron Staranowicz , Ryan Lustig , Desmond Chik
Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data from a video sequence; determining frame errors for the obtained two or more frames from the video sequence, determining whether the frame errors exceed a threshold value; performing a multi-pass operation; performing a single-pass operation; performing frame blending; performing edge correction; and generating the interpolated frame of image data.
-
公开(公告)号:US10057538B2
公开(公告)日:2018-08-21
申请号:US15407089
申请日:2017-01-16
Applicant: GoPro, Inc.
Inventor: Aaron Staranowicz , Ryan Lustig
Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data; performing Lagrangian interpolation on one or more portions of the obtained two or more frames of video data to generate a Lagrangian interpolated image; performing Eulerian interpolation on one or more portions of the obtained two or more frames to generate a Eulerian interpolated image; and when the Lagrangian interpolated image and the Eulerian interpolated image should be combined, computing an average interpolated image using the Lagrangian interpolated image and the Eulerian interpolated image; otherwise, selecting either the Lagrangian interpolated image or the Eulerian interpolated image; and generating an interpolated frame of video data using one or more of the average interpolated image, the Lagrangian interpolated image, or the Eulerian interpolated image.
-
4.
公开(公告)号:US10134114B2
公开(公告)日:2018-11-20
申请号:US15270971
申请日:2016-09-20
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig , Aaron Staranowicz
Abstract: Apparatus and methods for video image post-processing for segmentation based interpolation. In one embodiment, a computerized apparatus is utilized in order to obtain a first frame of video data; segment one or more objects within the first frame of video data; obtain a second frame of video data; segment one or more objects within the second frame of video data; match at least a portion of the one or more objects within the first frame of video data with the one or more objects within the second frame of video data; compute the motion of the pixels for the matched portion of the one or more objects; compute the motion of pixels associated with a background image; and generate an interpolated frame of video data, the interpolated frame of video data residing temporally between the first frame of video data and the second frame of video data.
-
5.
公开(公告)号:US20180082404A1
公开(公告)日:2018-03-22
申请号:US15270971
申请日:2016-09-20
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig , Aaron Staranowicz
CPC classification number: G06T5/002 , G06T3/4007 , G06T5/003 , G06T7/248 , G06T2207/10016 , G06T2207/10024
Abstract: Apparatus and methods for video image post-processing for segmentation based interpolation. In one embodiment, a computerized apparatus is utilized in order to obtain a first frame of video data; segment one or more objects within the first frame of video data; obtain a second frame of video data; segment one or more objects within the second frame of video data; match at least a portion of the one or more objects within the first frame of video data with the one or more objects within the second frame of video data; compute the motion of the pixels for the matched portion of the one or more objects; compute the motion of pixels associated with a background image; and generate an interpolated frame of video data, the interpolated frame of video data residing temporally between the first frame of video data and the second frame of video data.
-
6.
公开(公告)号:US20200160495A1
公开(公告)日:2020-05-21
申请号:US16692280
申请日:2019-11-22
Applicant: GoPro, Inc.
Inventor: Aaron Staranowicz , Ryan Lustig , Desmond Chik
Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data from a video sequence; determining frame errors for the obtained two or more frames from the video sequence, determining whether the frame errors exceed a threshold value; performing a multi-pass operation; performing a single-pass operation; performing frame blending; performing edge correction; and generating the interpolated frame of image data.
-
公开(公告)号:US20180205909A1
公开(公告)日:2018-07-19
申请号:US15407089
申请日:2017-01-16
Applicant: GoPro, Inc.
Inventor: Aaron Staranowicz , Ryan Lustig
IPC: H04N7/01
Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data; performing Lagrangian interpolation on one or more portions of the obtained two or more frames of video data to generate a Lagrangian interpolated image; performing Eulerian interpolation on one or more portions of the obtained two or more frames to generate a Eulerian interpolated image; and when the Lagrangian interpolated image and the Eulerian interpolated image should be combined, computing an average interpolated image using the Lagrangian interpolated image and the Eulerian interpolated image; otherwise, selecting either the Lagrangian interpolated image or the Eulerian interpolated image; and generating an interpolated frame of video data using one or more of the average interpolated image, the Lagrangian interpolated image, or the Eulerian interpolated image.
-
公开(公告)号:US20180063551A1
公开(公告)日:2018-03-01
申请号:US15251980
申请日:2016-08-30
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig , Aaron Staranowicz
CPC classification number: H04N19/172 , H04N19/132 , H04N19/137 , H04N19/146 , H04N19/162 , H04N19/587 , H04N19/96
Abstract: Apparatus and methods for generating interpolated frames in digital image or video data. In one embodiment, the interpolation is based on a hierarchical tree sequence. At each level of the tree, an interpolated frame may be generated using original or interpolated frames of the video, such as those closest in time to the desired time of the frame to be generated. The sequence proceeds through lower tree levels until a desired number of interpolated frames, a desired video length, a desired level, or a desired visual quality for the video is reached. In some implementations, the sequence may use different interpolation algorithms (e.g., of varying computational complexity or types) at different levels of the tree. The interpolation algorithms can include for example those based on frame repetition, frame averaging, motion compensated frame interpolation, and motion blending.
-
-
-
-
-
-
-