公开(公告)号：US20150154743A1

公开(公告)日：2015-06-04

申请号：US14615029

申请日：2015-02-05

Applicant: Google Inc.

Inventor： Sergey Ioffe ,  Troy Chinen ,  Vivek Kwatra ,  Hui Fang ,  Yichang Shih

IPC: G06T5/00 ,  G06T5/20 ,  G06T5/50

CPC classification number: G06T5/002 ,  G06K9/00221 ,  G06K9/00261 ,  G06K9/40 ,  G06T5/005 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10004 ,  G06T2207/10016 ,  G06T2207/20028 ,  G06T2207/20182 ,  G06T2207/20216 ,  G06T2207/30201

Abstract: A method, computer program product, and computer system for identifying a first portion of a facial image in a first image, wherein the first portion includes noise. A corresponding portion of the facial image is identified in a second image, wherein the corresponding portion includes less noise than the first portion. One or more filter parameters of the first portion are determined based upon, at least in part, the first portion and the corresponding portion. At least a portion of the noise from the first portion is smoothed based upon, at least in part, the one or more filter parameters. At least a portion of face specific details from the corresponding portion is added to the first portion.

Abstract translation: 一种用于识别第一图像中的面部图像的第一部分的方法，计算机程序产品和计算机系统，其中所述第一部分包括噪声。 面部图像的相应部分在第二图像中被识别，其中对应部分包括比第一部分少的噪声。 至少部分地基于第一部分和对应部分来确定第一部分的一个或多个过滤器参数。 至少部分地基于一个或多个过滤器参数来平滑来自第一部分的噪声的至少一部分。 来自相应部分的面部特定细节的至少一部分被添加到第一部分。

公开(公告)号：US20140327788A1

公开(公告)日：2014-11-06

申请号：US14332244

申请日：2014-07-15

Applicant: Google Inc.

Inventor： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

IPC: H04N5/232

CPC classification number: H04N5/23264 ,  H04N5/23254 ,  H04N5/23261 ,  H04N5/23267

Abstract: Methods and systems for processing a video for stabilization are described. A recorded video may be stabilized by removing at least a portion of shake introduced in the video. An original camera path for a camera used to record the video may be determined. A crop window size may be selected, a crop window transform may accordingly be determined, and the crop window transform may be applied to the original video to provide a modified video from a viewpoint of the modified motion camera path.

Abstract translation: 描述用于处理用于稳定的视频的方法和系统。 可以通过去除视频中引入的至少一部分抖动来稳定记录的视频。 可以确定用于记录视频的相机的原始相机路径。 可以选择裁剪窗口尺寸，因此可以确定裁剪窗口变换，并且可以将裁剪窗口变换应用于原始视频，以从修改的运动摄像机路径的视点提供修改的视频。

公开(公告)号：US08855437B1

公开(公告)日：2014-10-07

申请号：US13907000

申请日：2013-05-31

Applicant: Google, Inc.

Inventor： Jing-yu Cui ,  Vivek Kwatra ,  Michele Covell ,  Mei Han ,  Saurabh Mathur

IPC: G06K9/46 ,  G06T9/00

CPC classification number: G06T9/004 ,  G06K9/6219

Abstract: Compression of an image is performed based on prediction of target blocks of an image from candidate source blocks of the image. Heuristics are used for identifying the candidate source blocks, for example, source blocks are selected from within a cluster of similar blocks obtained by K-means clustering. For each target block, a region adjacent to the target block is identified and a set of candidate source blocks along with candidate source regions adjacent to the candidate source blocks are identified. The candidate source regions are ranked based on the differences between the candidate source regions and the target source region. Each candidate source block is described using its rank and residual information describing differences between the candidate source block and the target block. The candidate source block that can be described using a minimum amount of information is selected for predicting the target block.

Abstract translation: 基于来自图像的候选源块的图像的目标块的预测来执行图像的压缩。 启发式用于识别候选源块，例如，从通过K均值聚类获得的相似块的簇内选择源块。 对于每个目标块，识别与目标块相邻的区域，并且识别一组候选源块以及与候选源块相邻的候选源区。 基于候选源区域和目标源区域之间的差异对候选源区域进行排序。 使用其等级和残差信息描述候选源块和目标块之间的差异来描述每个候选源块。 选择可以使用最小量的信息描述的候选源块用于预测目标块。

公开(公告)号：US20140044404A1

公开(公告)日：2014-02-13

申请号：US14058411

申请日：2013-10-21

Applicant: Google Inc.

Inventor： Matthias Grundmann ,  Vivek Kwatra

IPC: H04N9/87

CPC classification number: H04N9/87 ,  H04N5/145 ,  H04N5/225 ,  H04N21/2187 ,  H04N21/23418 ,  H04N21/234345 ,  H04N21/4728 ,  H04N21/854

Abstract: Methods and systems for video retargeting and view selection using motion saliency are described. Salient features in multiple videos may be extracted. Each video may be retargeted by modifying the video to preserve the salient features. A crop path may be estimated and applied to a video to retarget each video and generate a modified video preserving the salient features. An action score may be assigned to portions or frames of each modified video to represent motion content in the modified video. Selecting a view from one of the given modified videos may be formulated as an optimization subject to constraints. An objective function for the optimization may include maximizing the action score. This optimization may also be subject to constraints to take into consideration optimal transitioning from a view from a given video to another view from another given video, for example.

Abstract translation: 描述了使用运动显着的视频重定向和视图选择的方法和系统。 可以提取多个视频中的显着特征。 可以通过修改视频来重定向每个视频以保持显着特征。 可以估计裁剪路径并将其应用于视频以重新定位每个视频，并生成维护显着特征的修改的视频。 可以将动作得分分配给每个经修改的视频的部分或帧以表示经修改的视频中的运动内容。 从给定的修改的视频之一选择视图可以被制定为受约束的优化。 优化的目标函数可以包括最大化动作得分。 例如，这种优化也可能受到约束，以考虑从给定视频的视图到另一给定视频的另一视图的最佳转换。

公开(公告)号：US20180350131A1

公开(公告)日：2018-12-06

申请号：US14587420

申请日：2014-12-31

Applicant: Google Inc.

Inventor： Irfan Essa ,  Vivek Kwatra ,  Matthias Grundmann

IPC: G06T15/10

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for video segmentation. One of the methods includes receiving a digital video; performing hierarchical graph-based video segmentation on at least one frame of the digital video to generate a boundary representation for the at least one frame; generating a vector representation from the boundary representation for the at least one frame of the digital video, wherein generating the vector representation includes generating a polygon composed of at least three vectors, wherein each vector comprises two vertices connected by a line segment, from a boundary in the boundary representation; linking the vector representation to the at least one frame of the digital video; and storing the vector representation with the at least one frame of the digital video.

公开(公告)号：US20170195575A1

公开(公告)日：2017-07-06

申请号：US15463127

申请日：2017-03-20

Applicant: Google Inc.

Inventor： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

IPC: H04N5/232 ,  G06K9/00 ,  G06T7/246

CPC classification number: H04N5/23267 ,  G06K9/00718 ,  G06K9/00744 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/20021 ,  G06T2207/30244 ,  H04N5/23248 ,  H04N5/23254 ,  H04N5/2329

Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.

公开(公告)号：US20160216848A1

公开(公告)日：2016-07-28

申请号：US15092102

申请日：2016-04-06

Applicant: Google Inc.

Inventor： Sergey Ioffe ,  Vivek Kwatra ,  Matthias Grundmann

IPC: G06F3/0481

CPC classification number: G06F3/0481 ,  G06F16/4393 ,  G06F16/58

Abstract: A computer-implemented method, computer program product, and computing system is provided for interacting with images having similar content. In an embodiment, a method may include identifying a plurality of photographs as including a common characteristic. The method may also include generating a flipbook media item including the plurality of photographs. The method may further include associating one or more interactive control features with the flipbook media item.

Abstract translation: 提供了计算机实现的方法，计算机程序产品和计算系统，用于与具有相似内容的图像进行交互。 在一个实施例中，方法可以包括将多个照片识别为包括共同特征。 该方法还可以包括生成包括多张照片的翻页媒体项目。 该方法可以进一步包括将一个或多个交互式控制特征与翻录媒体项目相关联。

公开(公告)号：US09357129B1

公开(公告)日：2016-05-31

申请号：US14498004

申请日：2014-09-26

Applicant: Google Inc.

Inventor： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

IPC: H04N5/228 ,  H04N5/335 ,  H04N5/232

CPC classification number: H04N5/23264 ,  G06T5/003 ,  G06T7/246 ,  G06T2207/20201

Abstract: Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.

Abstract translation: 描述滚动快门拆卸的方法和系统。 计算设备可以被配置为在视频的帧中确定可区分的特征。 帧可以包括异步捕获的像素集合。 计算设备可以被配置为针对表示帧中的特征的像素来确定代表连续帧中的特征的对应像素; 并且对于包括帧中的像素的一组像素，确定可以表示相机的运动的投影变换。 计算设备可以被配置为针对帧中的像素集合，基于针对其他像素集合确定的投影变换和相应的投影变换的组合来确定混合变换。 因此，计算设备可以被配置为估计相机的运动路径以考虑与该组像素的异步捕获相关联的失真。

公开(公告)号：US20160150160A1

公开(公告)日：2016-05-26

申请号：US14498004

申请日：2014-09-26

Applicant: Google Inc.

Inventor： Matthias Grundmann ,  Vivek Kwatra ,  Irfan Essa

IPC: H04N5/232

CPC classification number: H04N5/23264 ,  G06T5/003 ,  G06T7/246 ,  G06T2207/20201

Abstract: Methods and systems for rolling shutter removal are described. A computing device may be configured to determine, in a frame of a video, distinguishable features. The frame may include sets of pixels captured asynchronously. The computing device may be configured to determine for a pixel representing a feature in the frame, a corresponding pixel representing the feature in a consecutive frame; and determine, for a set of pixels including the pixel in the frame, a projective transform that may represent motion of the camera. The computing device may be configured to determine, for the set of pixels in the frame, a mixture transform based on a combination of the projective transform and respective projective transforms determined for other sets of pixels. Accordingly, the computing device may be configured to estimate a motion path of the camera to account for distortion associated with the asynchronous capturing of the sets of pixels.

Abstract translation: 描述滚动快门拆卸的方法和系统。 计算设备可以被配置为在视频的帧中确定可区分的特征。 帧可以包括异步捕获的像素集合。 计算设备可以被配置为针对表示帧中的特征的像素来确定代表连续帧中的特征的对应像素; 并且对于包括帧中的像素的一组像素，确定可以表示相机的运动的投影变换。 计算设备可以被配置为针对帧中的像素集合，基于针对其他像素集合确定的投影变换和相应的投影变换的组合来确定混合变换。 因此，计算设备可以被配置为估计相机的运动路径以考虑与该组像素的异步捕获相关联的失真。

公开(公告)号：US20140341482A1

公开(公告)日：2014-11-20

申请号：US13894335

申请日：2013-05-14

Applicant: Google Inc.

Inventor： Erik Murphy-Chutorian ,  Matthew Steiner ,  Vivek Kwatra ,  Shengyang Dai ,  John Spiegel ,  Nicholas Butko ,  Falk Sticken ,  Florian Kriener ,  Tom Binder ,  John Flynn ,  Troy Chinen ,  Steven VanDeBogart ,  Nikolaos Trogkanis ,  Ingo Wehmeyer ,  Matthias Grundmann

IPC: G06T11/60

CPC classification number: G06K9/6218 ,  G06F17/30247 ,  G06K9/00228 ,  G06K9/00677 ,  G06T11/60

Abstract: Implementations generally relate to generating compositional media content. In some implementations, a method includes receiving a plurality of photos from a user, and determining one or more composition types from the photos. The method also includes generating compositions from the selected photos based on the one or more determined composition types. The method also includes providing the one or more generated compositions to the user.

Abstract translation: 实现通常涉及生成组合媒体内容。 在一些实现中，一种方法包括从用户接收多张照片，以及从照片中确定一个或多个合成类型。 该方法还包括基于一种或多种所确定的组合物类型从所选择的照片生成组合物。 该方法还包括向使用者提供一种或多种生成的组合物。