公开(公告)号：US20140327788A1

公开(公告)日：2014-11-06

申请号：US14332244

申请日：2014-07-15

Applicant: Google Inc.

Inventor： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

IPC: H04N5/232

CPC classification number: H04N5/23264 ,  H04N5/23254 ,  H04N5/23261 ,  H04N5/23267

Abstract: Methods and systems for processing a video for stabilization are described. A recorded video may be stabilized by removing at least a portion of shake introduced in the video. An original camera path for a camera used to record the video may be determined. A crop window size may be selected, a crop window transform may accordingly be determined, and the crop window transform may be applied to the original video to provide a modified video from a viewpoint of the modified motion camera path.

Abstract translation: 描述用于处理用于稳定的视频的方法和系统。 可以通过去除视频中引入的至少一部分抖动来稳定记录的视频。 可以确定用于记录视频的相机的原始相机路径。 可以选择裁剪窗口尺寸，因此可以确定裁剪窗口变换，并且可以将裁剪窗口变换应用于原始视频，以从修改的运动摄像机路径的视点提供修改的视频。

公开(公告)号：US20140044404A1

公开(公告)日：2014-02-13

申请号：US14058411

申请日：2013-10-21

Applicant: Google Inc.

Inventor： Matthias Grundmann ,  Vivek Kwatra

IPC: H04N9/87

CPC classification number: H04N9/87 ,  H04N5/145 ,  H04N5/225 ,  H04N21/2187 ,  H04N21/23418 ,  H04N21/234345 ,  H04N21/4728 ,  H04N21/854

Abstract: Methods and systems for video retargeting and view selection using motion saliency are described. Salient features in multiple videos may be extracted. Each video may be retargeted by modifying the video to preserve the salient features. A crop path may be estimated and applied to a video to retarget each video and generate a modified video preserving the salient features. An action score may be assigned to portions or frames of each modified video to represent motion content in the modified video. Selecting a view from one of the given modified videos may be formulated as an optimization subject to constraints. An objective function for the optimization may include maximizing the action score. This optimization may also be subject to constraints to take into consideration optimal transitioning from a view from a given video to another view from another given video, for example.

Abstract translation: 描述了使用运动显着的视频重定向和视图选择的方法和系统。 可以提取多个视频中的显着特征。 可以通过修改视频来重定向每个视频以保持显着特征。 可以估计裁剪路径并将其应用于视频以重新定位每个视频，并生成维护显着特征的修改的视频。 可以将动作得分分配给每个经修改的视频的部分或帧以表示经修改的视频中的运动内容。 从给定的修改的视频之一选择视图可以被制定为受约束的优化。 优化的目标函数可以包括最大化动作得分。 例如，这种优化也可能受到约束，以考虑从给定视频的视图到另一给定视频的另一视图的最佳转换。

公开(公告)号：US20180350131A1

公开(公告)日：2018-12-06

申请号：US14587420

申请日：2014-12-31

Applicant: Google Inc.

Inventor： Irfan Essa ,  Vivek Kwatra ,  Matthias Grundmann

IPC: G06T15/10

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for video segmentation. One of the methods includes receiving a digital video; performing hierarchical graph-based video segmentation on at least one frame of the digital video to generate a boundary representation for the at least one frame; generating a vector representation from the boundary representation for the at least one frame of the digital video, wherein generating the vector representation includes generating a polygon composed of at least three vectors, wherein each vector comprises two vertices connected by a line segment, from a boundary in the boundary representation; linking the vector representation to the at least one frame of the digital video; and storing the vector representation with the at least one frame of the digital video.

公开(公告)号：US20170195575A1

公开(公告)日：2017-07-06

申请号：US15463127

申请日：2017-03-20

Applicant: Google Inc.

Inventor： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

IPC: H04N5/232 ,  G06K9/00 ,  G06T7/246

CPC classification number: H04N5/23267 ,  G06K9/00718 ,  G06K9/00744 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/20021 ,  G06T2207/30244 ,  H04N5/23248 ,  H04N5/23254 ,  H04N5/2329

Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.

公开(公告)号：US20160216848A1

公开(公告)日：2016-07-28

申请号：US15092102

申请日：2016-04-06

Applicant: Google Inc.

Inventor： Sergey Ioffe ,  Vivek Kwatra ,  Matthias Grundmann

IPC: G06F3/0481

CPC classification number: G06F3/0481 ,  G06F16/4393 ,  G06F16/58

Abstract: A computer-implemented method, computer program product, and computing system is provided for interacting with images having similar content. In an embodiment, a method may include identifying a plurality of photographs as including a common characteristic. The method may also include generating a flipbook media item including the plurality of photographs. The method may further include associating one or more interactive control features with the flipbook media item.

Abstract translation: 提供了计算机实现的方法，计算机程序产品和计算系统，用于与具有相似内容的图像进行交互。 在一个实施例中，方法可以包括将多个照片识别为包括共同特征。 该方法还可以包括生成包括多张照片的翻页媒体项目。 该方法可以进一步包括将一个或多个交互式控制特征与翻录媒体项目相关联。

公开(公告)号：US09357129B1

公开(公告)日：2016-05-31

申请号：US14498004

申请日：2014-09-26

Applicant: Google Inc.

Inventor： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

IPC: H04N5/228 ,  H04N5/335 ,  H04N5/232

CPC classification number: H04N5/23264 ,  G06T5/003 ,  G06T7/246 ,  G06T2207/20201

Abstract: Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.

Abstract translation: 描述滚动快门拆卸的方法和系统。 计算设备可以被配置为在视频的帧中确定可区分的特征。 帧可以包括异步捕获的像素集合。 计算设备可以被配置为针对表示帧中的特征的像素来确定代表连续帧中的特征的对应像素; 并且对于包括帧中的像素的一组像素，确定可以表示相机的运动的投影变换。 计算设备可以被配置为针对帧中的像素集合，基于针对其他像素集合确定的投影变换和相应的投影变换的组合来确定混合变换。 因此，计算设备可以被配置为估计相机的运动路径以考虑与该组像素的异步捕获相关联的失真。

公开(公告)号：US20160150160A1

公开(公告)日：2016-05-26

申请号：US14498004

申请日：2014-09-26

Applicant: Google Inc.

Inventor： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

IPC: H04N5/232

CPC classification number: H04N5/23264 ,  G06T5/003 ,  G06T7/246 ,  G06T2207/20201

Abstract: Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.

Abstract translation: 描述滚动快门拆卸的方法和系统。 计算设备可以被配置为在视频的帧中确定可区分的特征。 帧可以包括异步捕获的像素集合。 计算设备可以被配置为针对表示帧中的特征的像素来确定代表连续帧中的特征的对应像素; 并且对于包括帧中的像素的一组像素，确定可以表示相机的运动的投影变换。 计算设备可以被配置为针对帧中的像素集合，基于针对其他像素集合确定的投影变换和相应的投影变换的组合来确定混合变换。 因此，计算设备可以被配置为估计相机的运动路径以考虑与该组像素的异步捕获相关联的失真。

公开(公告)号：US20140341482A1

公开(公告)日：2014-11-20

申请号：US13894335

申请日：2013-05-14

Applicant: Google Inc.

Inventor： Erik Murphy-Chutorian ,  Matthew Steiner ,  Vivek Kwatra ,  Shengyang Dai ,  John Spiegel ,  Nicholas Butko ,  Falk Sticken ,  Florian Kriener ,  Tom Binder ,  John Flynn ,  Troy Chinen ,  Steven VanDeBogart ,  Nikolaos Trogkanis ,  Ingo Wehmeyer ,  Matthias Grundmann

IPC: G06T11/60

CPC classification number: G06K9/6218 ,  G06F17/30247 ,  G06K9/00228 ,  G06K9/00677 ,  G06T11/60

Abstract: Implementations generally relate to generating compositional media content. In some implementations, a method includes receiving a plurality of photos from a user, and determining one or more composition types from the photos. The method also includes generating compositions from the selected photos based on the one or more determined composition types. The method also includes providing the one or more generated compositions to the user.

Abstract translation: 实现通常涉及生成组合媒体内容。 在一些实现中，一种方法包括从用户接收多张照片，以及从照片中确定一个或多个合成类型。 该方法还包括基于一种或多种所确定的组合物类型从所选择的照片生成组合物。 该方法还包括向使用者提供一种或多种生成的组合物。

公开(公告)号：US10262420B1

公开(公告)日：2019-04-16

申请号：US15586063

申请日：2017-05-03

Applicant: Google Inc.

Inventor： Amanda Conway ,  Matthias Grundmann ,  Christian Ingemar Falk

IPC: G06K9/00 ,  G06T7/11 ,  G06K9/52 ,  G06K9/46

Abstract: Systems and methods are disclosed for tracking regions within a media item. A method includes identifying a region in a first frame of a media item using a first user specified position; calculating, based on the first user specified position and on tracking data, an estimated position of the region within a second frame of the media item and an estimated position of the region within a third frame of the media item; adjusting the estimated position of the region within the second frame to a second user specified position; blending, by a processing device, the estimated position within the third frame based on the second user specified position of the second frame to generate a blended position within the third frame; and storing, in a data store, the blended position within the third frame.

公开(公告)号：US09646222B1

公开(公告)日：2017-05-09

申请号：US14628904

申请日：2015-02-23

Applicant: Google Inc.

Inventor： Amanda Conway ,  Matthias Grundmann ,  Christian Ingemar Falk

IPC: G06K9/00 ,  G06K9/52 ,  G06T11/60 ,  G06K9/46

CPC classification number: G06K9/52 ,  G06K9/00711 ,  G06K9/3233 ,  G06K9/46 ,  G06K2009/4666 ,  G06T5/00 ,  G06T11/60 ,  G06T2207/10016 ,  G06T2207/20104 ,  G06T2207/20221

Abstract: Systems and methods are disclosed for tracking and distorting regions within a media item. A method includes identifying a region in a first frame of a media item using a first user specified position, calculating based on tracking data an estimated position of the region within a second frame of the media item and an estimated position of the region within a third frame of the media item, adjusting based on user input the estimated position of the region within the second frame to a second user specified position, blending the estimated position within the third frame based on the user specified position of the second frame to generate a blended position within the third frame, and modifying the third frame to distort the region underlying the blended position.