-
公开(公告)号:US10824911B2
公开(公告)日:2020-11-03
申请号:US15973184
申请日:2018-05-07
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
Abstract: An algorithm for performing an image or video processing task is generated that may be used to combine a plurality of different independent solutions to the image or video processing task in an optimized manner. A plurality of base algorithms may be applied to a training set of images or video and a first generation of different combining algorithms may be applied to combine the respective solutions from each of the respective base algorithms into respective combined solutions. The respective combined solutions may be evaluated to generate respective fitness scores representing measures of how well the plurality of different combining algorithms each perform the image or video processing task. The algorithms may be iteratively updated to generate an optimized combining algorithm that may be applied to an input image or video.
-
2.
公开(公告)号:US20180315174A1
公开(公告)日:2018-11-01
申请号:US15583794
申请日:2017-05-01
Applicant: GOPRO, INC.
Inventor: Aaron Staranowicz , Ryan Lustig , Desmond Chik
Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data from a video sequence; determining frame errors for the obtained two or more frames from the video sequence, determining whether the frame errors exceed a threshold value; performing a multi-pass operation; performing a single-pass operation; performing frame blending; performing edge correction; and generating the interpolated frame of image data.
-
公开(公告)号:US10057538B2
公开(公告)日:2018-08-21
申请号:US15407089
申请日:2017-01-16
Applicant: GoPro, Inc.
Inventor: Aaron Staranowicz , Ryan Lustig
Abstract: Methods and apparatus for the generation of interpolated frames of video data. In one embodiment, the interpolated frames of video data are generated by obtaining two or more frames of video data; performing Lagrangian interpolation on one or more portions of the obtained two or more frames of video data to generate a Lagrangian interpolated image; performing Eulerian interpolation on one or more portions of the obtained two or more frames to generate a Eulerian interpolated image; and when the Lagrangian interpolated image and the Eulerian interpolated image should be combined, computing an average interpolated image using the Lagrangian interpolated image and the Eulerian interpolated image; otherwise, selecting either the Lagrangian interpolated image or the Eulerian interpolated image; and generating an interpolated frame of video data using one or more of the average interpolated image, the Lagrangian interpolated image, or the Eulerian interpolated image.
-
公开(公告)号:US10003768B2
公开(公告)日:2018-06-19
申请号:US15278976
申请日:2016-09-28
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
IPC: H04N7/01
CPC classification number: H04N7/0137 , G06T3/40 , H04N7/0127 , H04N7/014
Abstract: Apparatus and methods for the generation of interpolated frames of video data. In one embodiment, a computerized apparatus is disclosed that includes a video data interface configured to receive frames of video data; a processing apparatus in data communication with the video data interface; and a storage apparatus in data communication with the processing apparatus. The computerized apparatus is further configured to: receive frames of captured video data; retrieve capture parameters associated with the frames of captured video data; generate optical flow parameters from the frames of captured video data; ascribe differing weights based on the capture parameters and/or the optical flow parameters; generate frames of interpolated video data for the frames of captured video data based at least in part on the ascribed weights; and compile a resultant video stream using the frames of interpolated video data and the frames of captured video data.
-
公开(公告)号:US20170094196A1
公开(公告)日:2017-03-30
申请号:US15080302
申请日:2016-03-24
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
CPC classification number: H04N5/272 , G06T5/002 , G06T7/11 , G06T7/143 , G06T7/174 , G06T7/194 , G06T7/20 , G06T7/254 , G06T11/60 , G06T15/503 , G06T2207/10016 , G06T2207/10021 , G06T2207/20036 , H04N5/2356 , H04N13/128 , H04N2013/0085 , H04N2013/0092
Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
-
6.
公开(公告)号:US20170094195A1
公开(公告)日:2017-03-30
申请号:US15080299
申请日:2016-03-24
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
CPC classification number: H04N5/272 , G06T5/002 , G06T7/11 , G06T7/143 , G06T7/174 , G06T7/194 , G06T7/20 , G06T7/254 , G06T11/60 , G06T15/503 , G06T2207/10016 , G06T2207/10021 , G06T2207/20036 , H04N5/2356 , H04N13/128 , H04N2013/0085 , H04N2013/0092
Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
-
7.
公开(公告)号:US11095833B2
公开(公告)日:2021-08-17
申请号:US16833185
申请日:2020-03-27
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
IPC: H04N5/272 , G06T15/50 , H04N13/128 , G06T11/60 , G06T7/11 , G06T7/143 , G06T7/194 , G06T7/174 , G06T7/254 , G06T5/00 , G06T7/20 , H04N5/235 , H04N13/00
Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
-
8.
公开(公告)号:US10609307B2
公开(公告)日:2020-03-31
申请号:US15080299
申请日:2016-03-24
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
IPC: H04N5/272 , G06T15/50 , H04N13/128 , G06T11/60 , G06T7/11 , G06T7/143 , G06T7/194 , G06T7/174 , G06T7/254 , G06T5/00 , G06T7/20 , H04N5/235 , H04N13/00
Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
-
9.
公开(公告)号:US20190180110A1
公开(公告)日:2019-06-13
申请号:US16256669
申请日:2019-01-24
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig , David A. Newman
IPC: G06K9/00 , G06T7/246 , H04N19/513
Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. In one example, best scenes are identified based on the motion values associated with frames or portions of a frame of a video. Motion values are determined for each frame and portions of the video including frames with the most motion are identified as best scenes. Best scenes may also be identified based on the motion profile of a video. The motion profile of a video is a measure of global or local motion within frames throughout the video. For example, best scenes are identified from portion of the video including steady global motion. A video summary can be generated including one or more of the identified best scenes.
-
公开(公告)号:US10051206B2
公开(公告)日:2018-08-14
申请号:US15080292
申请日:2016-03-24
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
IPC: H04N5/272 , G06T7/20 , H04N13/00 , H04N5/235 , G06T5/00 , G06T7/00 , G06T15/50 , G06T11/60 , G06T7/11 , G06T7/143 , G06T7/194 , G06T7/174 , G06T7/254
Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
-
-
-
-
-
-
-
-
-