System and method for using segmentation to identify object location in images

    公开(公告)号:US10061999B1

    公开(公告)日:2018-08-28

    申请号:US15339616

    申请日:2016-10-31

    Applicant: Google Inc.

    Abstract: An example method is disclosed that includes identifying a training set of images, wherein each image in the training set has an identified bounding box that comprises an object class and an object location for an object in the image. The method also includes segmenting each image of the training set, wherein segments comprise sets of pixels that share visual characteristics, and wherein each segment is associated with an object class. The method further includes clustering the segments that are associated with the same object class, and generating a data structure based on the clustering, wherein entries in the data structure comprise visual characteristics for prototypical segments of objects having the object class and further comprise one or more potential bounding boxes for the objects, wherein the data structure is usable to predict bounding boxes of additional images that include an object having the object class.

    SYSTEMS AND METHODS FOR RESIZING AN IMAGE
    35.
    发明申请
    SYSTEMS AND METHODS FOR RESIZING AN IMAGE 有权
    用于校正图像的系统和方法

    公开(公告)号:US20150036947A1

    公开(公告)日:2015-02-05

    申请号:US14517423

    申请日:2014-10-17

    Applicant: Google Inc.

    CPC classification number: G06K9/18 G06T3/0012

    Abstract: In some instances, an image may have dimensions that do not correspond to a slot to display the image. For example, an image content item may have dimensions that do not correspond to a content item slot. The image may be resized using seam carving to add or remove pixels of the image. A saliency map for the image may be used having saliency scores for each pixel of the image. Evaluation metrics may be used before, during, and after, seam carving to determine whether salient content is affected by the seam carving. In some instances, a seam cost threshold value may be used for adaptive step size during the seam carving. The resized image may then be outputted, such as for an image content item to be served with a resource.

    Abstract translation: 在某些情况下,图像可能具有不对应于显示图像的时隙的尺寸。 例如,图像内容项目可以具有与内容项目时隙不对应的维度。 可以使用接缝雕刻来调整图像的大小,以添加或删除图像的像素。 可以使用图像的显着图,其具有图像的每个像素的显着性分数。 评估指标可以在缝合雕刻之前,之中和之后使用,以确定显着含量是否受到缝合雕刻的影响。 在一些情况下,在缝合雕刻期间可以使用接缝成本阈值用于自适应步长。 然后可以输出调整大小的图像,例如用于要与资源一起服务的图像内容项目。

    GENERATING PHOTO ANIMATIONS
    36.
    发明申请
    GENERATING PHOTO ANIMATIONS 有权
    生成照片动画

    公开(公告)号:US20140340409A1

    公开(公告)日:2014-11-20

    申请号:US13894198

    申请日:2013-05-14

    Applicant: Google Inc.

    CPC classification number: G06T13/80 G06T7/97

    Abstract: Implementations generally relate to generating photo animations. In some implementations, a method includes receives a plurality of photos from a user. The method also includes selecting photos from the plurality of photos that meet one or more predetermined similarity criteria. The method also includes generating an animation using the selected photos.

    Abstract translation: 实现通常涉及生成照片动画。 在一些实现中,一种方法包括从用户接收多张照片。 该方法还包括从满足一个或多个预定相似性标准的多个照片中选择照片。 该方法还包括使用所选择的照片生成动画。

    CASCADED CAMERA MOTION ESTIMATION, ROLLING SHUTTER DETECTION, AND CAMERA SHAKE DETECTION FOR VIDEO STABILIZATION
    37.
    发明申请
    CASCADED CAMERA MOTION ESTIMATION, ROLLING SHUTTER DETECTION, AND CAMERA SHAKE DETECTION FOR VIDEO STABILIZATION 有权
    CASCADED CAMERA运动估计,滚动快门检测和视频稳定的相机SHAKE检测

    公开(公告)号:US20140267801A1

    公开(公告)日:2014-09-18

    申请号:US13854819

    申请日:2013-04-01

    Applicant: Google Inc.

    Abstract: An easy-to-use online video stabilization system and methods for its use are described. Videos are stabilized after capture, and therefore the stabilization works on all forms of video footage including both legacy video and freshly captured video. In one implementation, the video stabilization system is fully automatic, requiring no input or parameter settings by the user other than the video itself. The video stabilization system uses a cascaded motion model to choose the correction that is applied to different frames of a video. In various implementations, the video stabilization system is capable of detecting and correcting high frequency jitter artifacts, low frequency shake artifacts, rolling shutter artifacts, significant foreground motion, poor lighting, scene cuts, and both long and short videos.

    Abstract translation: 描述了一种易于使用的在线视频稳定系统及其使用方法。 视频在拍摄后稳定,因此稳定性适用于所有形式的视频素材,包括传统视频和新鲜捕获的视频。 在一个实现中,视频稳定系统是全自动的,除了视频本身之外,不需要用户的输入或参数设置。 视频稳定系统使用级联运动模型来选择应用于视频的不同帧的校正。 在各种实施方案中,视频稳定系统能够检测和校正高频抖动伪像,低频抖动伪影,滚动快门伪像,显着的前景运动,差的照明,场景切换以及长视频和短视频。

    Image compression using exemplar dictionary based on hierarchical clustering
    38.
    发明授权
    Image compression using exemplar dictionary based on hierarchical clustering 有权
    使用基于层次聚类的示范字典的图像压缩

    公开(公告)号:US08787692B1

    公开(公告)日:2014-07-22

    申请号:US13946965

    申请日:2013-07-19

    Applicant: Google Inc.

    CPC classification number: G06K9/6219 G06K9/6807 H04N19/30 H04N19/90

    Abstract: An exemplar dictionary is built from example image blocks for determining predictor blocks for encoding and decoding images. The exemplar dictionary comprises a hierarchical organization of example image blocks. The hierarchical organization of image blocks is obtained by clustering a set of example image blocks, for example, based on k-means clustering. Performance of clustering is improved by transforming feature vectors representing the image blocks to fewer dimensions. Principal component analysis is used for determining feature vectors with fewer dimensions. The clustering performed at higher levels of the hierarchy uses fewer dimensions of feature vectors compared to lower levels of hierarchy. Performance of clustering is improved by processing only a sample of the image blocks of a cluster. The clustering performed at higher levels of the hierarchy uses lower sampling rates as compared to lower levels of hierarchy.

    Abstract translation: 从用于确定用于对图像进行编码和解码的预测器块的示例图像块构建示范字典。 示例性字典包括示例图像块的分级组织。 通过例如基于k均值聚类来聚类一组示例图像块来获得图像块的分级组织。 通过将表示图像块的特征向量变换为较少的维度来提高聚类的性能。 主成分分析用于确定尺寸较小的特征向量。 在层次较高的层次上执行的聚类与较低级别的层次相比,使用较少的特征向量维度。 通过仅处理集群的图像块的样本来提高聚类的性能。 与较低级别的层次相比,在较高层次上执行的聚类使用较低的采样率。

Patent Agency Ranking