Combined composition and change-based models for image cropping

    公开(公告)号:US10019823B2

    公开(公告)日:2018-07-10

    申请号:US14062751

    申请日:2013-10-24

    Abstract: In techniques of combined composition and change-based models for image cropping, a composition application is implemented to apply one or more image composition modules of a learned composition model to evaluate multiple composition regions of an image. The learned composition model can determine one or more cropped images from the image based on the applied image composition modules, and evaluate a composition of the cropped images and a validity of change from the image to the cropped images. The image composition modules of the learned composition model include a salient regions module that iteratively determines salient image regions of the image, and include a foreground detection module that determines foreground regions of the image. The image composition modules also include one or more imaging models that reduce a number of the composition regions of the image to facilitate determining the cropped images from the image.

    Convolutional Neural Network Joint Training
    43.
    发明申请

    公开(公告)号:US20170357892A1

    公开(公告)日:2017-12-14

    申请号:US15177121

    申请日:2016-06-08

    Abstract: In embodiments of convolutional neural network joint training, a computing system memory maintains different data batches of multiple digital image items, where the digital image items of the different data batches have some common features. A convolutional neural network (CNN) receives input of the digital image items of the different data batches, and classifier layers of the CNN are trained to recognize the common features in the digital image items of the different data batches. The recognized common features are input to fully-connected layers of the CNN that distinguish between the recognized common features of the digital image items of the different data batches. A scoring difference is determined between item pairs of the digital image items in a particular one of the different data batches. A piecewise ranking loss algorithm maintains the scoring difference between the item pairs, and the scoring difference is used to train CNN regression functions.

    UTILIZING DEEP LEARNING FOR RATING AESTHETICS OF DIGITAL IMAGES

    公开(公告)号:US20170294010A1

    公开(公告)日:2017-10-12

    申请号:US15097113

    申请日:2016-04-12

    Abstract: Systems and methods are disclosed for estimating aesthetic quality of digital images using deep learning. In particular, the disclosed systems and methods describe training a neural network to generate an aesthetic quality score digital images. In particular, the neural network includes a training structure that compares relative rankings of pairs of training images to accurately predict a relative ranking of a digital image. Additionally, in training the neural network, an image rating system can utilize content-aware and user-aware sampling techniques to identify pairs of training images that have similar content and/or that have been rated by the same or different users. Using content-aware and user-aware sampling techniques, the neural network can be trained to accurately predict aesthetic quality ratings that reflect subjective opinions of most users as well as provide aesthetic scores for digital images that represent the wide spectrum of aesthetic preferences of various users.

    Saliency map computation
    46.
    发明授权
    Saliency map computation 有权
    显着图计算

    公开(公告)号:US09454712B2

    公开(公告)日:2016-09-27

    申请号:US14510000

    申请日:2014-10-08

    CPC classification number: G06K9/4671 G06T11/60

    Abstract: Saliency map computation is described. In one or more implementations, a base saliency map is generated for an image of a scene. The base saliency map may be generated from intermediate saliency maps computed for boundary regions of the image. Each of the intermediate saliency maps may represent visual saliency of portions of the scene that are captured in the corresponding boundary region. The boundary regions may include, for instance, a top boundary region, a bottom boundary region, a left boundary region, and a right boundary region. Further, the intermediate saliency maps may be combined in such a way that an effect of a foreground object on the saliency map is suppressed. The foreground objects for which the effect is suppressed are those that occupy a majority of one of the boundary regions.

    Abstract translation: 描述了显着地图计算。 在一个或多个实现中,为场景的图像生成基本显着图。 可以从为图像的边界区域计算的中间显着图生成基本显着图。 每个中间显着图可以表示在相应边界区域中捕获的场景的部分的视觉显着性。 边界区域可以包括例如顶边界区域,底边界区域,左边界区域和右边界区域。 此外,中间显着图可以以这样的方式组合,即前景对象对显着图的影响被抑制。 效果被抑制的前景对象是占据边界区域中的大多数的那些。

    Methods and apparatus for 3D camera positioning using a 2D vanishing point grid
    47.
    发明授权
    Methods and apparatus for 3D camera positioning using a 2D vanishing point grid 有权
    使用2D消失点网格的3D摄像机定位的方法和装置

    公开(公告)号:US09330466B2

    公开(公告)日:2016-05-03

    申请号:US13689319

    申请日:2012-11-29

    CPC classification number: G06T7/0042 G06T15/20 G06T19/006

    Abstract: Methods and apparatus for three-dimensional (3D) camera positioning using a two-dimensional (2D) vanishing point grid. A vanishing point grid in a scene and initial camera parameters may be obtained. A new 3D camera may be calculated according to the vanishing point grid that places the grid as a ground plane in a scene. A 3D object may then be placed on the ground plane in the scene as defined by the 3D camera. The 3D object may be placed at the center of the vanishing point grid. Once placed, the 3D object can be moved to other locations on the ground plane or otherwise manipulated. The 3D object may be added as a layer in the image.

    Abstract translation: 使用二维(2D)消失点网格的三维(3D)摄像机定位的方法和装置。 可以获得场景中的消失点网格和初始摄像机参数。 可以根据将网格作为地平面放置在场景中的消失点网格来计算新的3D照相机。 然后可以将3D物体放置在由3D照相机定义的场景中的地平面上。 3D对象可以放置在消失点网格的中心。 一旦放置,3D物体可以移动到地平面上的其他位置或以其他方式操纵。 3D对象可以作为图像中的图层添加。

    Cropping boundary simplicity
    48.
    发明授权
    Cropping boundary simplicity 有权
    裁剪边界简洁

    公开(公告)号:US09251594B2

    公开(公告)日:2016-02-02

    申请号:US14169025

    申请日:2014-01-30

    Abstract: Cropping boundary simplicity techniques are described. In one or more implementations, multiple candidate croppings of a scene are generated. For each of the candidate croppings, a score is calculated that is indicative of a boundary simplicity for the candidate cropping. To calculate the boundary simplicity, complexity of the scene along a boundary of a respective candidate cropping is measured. The complexity is measured, for instance, using an average gradient, an image edge map, or entropy along the boundary. Values indicative of the complexity may be derived from the measuring. The candidate croppings may then be ranked according to those values. Based on the scores calculated to indicate the boundary simplicity, one or more of the candidate croppings may be chosen e.g., to present the chosen croppings to a user for selection.

    Abstract translation: 描述边界简单技术。 在一个或多个实现中,生成场景的多个候选裁剪。 对于每个候选作物,计算表示候选种植的边界简单性的分数。 为了计算边界简单性,测量沿着相应候选剪切的边界的场景的复杂性。 测量复杂度,例如,使用沿着边界的平均梯度,图像边缘图或熵。 表示复杂性的值可以从测量得出。 然后可以根据这些值对候选作物进行排序。 基于计算的用于指示边界简单性的分数,可以选择一个或多个候选剪切,以将所选择的剪切呈现给用户进行选择。

    Image Cropping suggestion
    49.
    发明授权
    Image Cropping suggestion 有权
    图像裁剪建议

    公开(公告)号:US09245347B2

    公开(公告)日:2016-01-26

    申请号:US14169073

    申请日:2014-01-30

    Abstract: Image cropping suggestion is described. In one or more implementations, multiple croppings of a scene are scored based on parameters that indicate visual characteristics established for visually pleasing croppings. The parameters may include a parameter that indicates composition quality of a candidate cropping, for example. The parameters may also include a parameter that indicates whether content appearing in the scene is preserved and a parameter that indicates simplicity of a boundary of a candidate cropping. Based on the scores, image croppings may be chosen, e.g., to present the chosen image croppings to a user for selection. To choose the croppings, they may be ranked according to the score and chosen such that consecutively ranked croppings are not chosen. Alternately or in addition, image croppings may be chosen that are visually different according to scores which indicate those croppings have different visual characteristics.

    Abstract translation: 描述了图像裁剪建议。 在一个或多个实现中,基于指示为视觉上令人满意的裁剪而建立的视觉特征的参数对场景进行多次裁剪。 参数可以包括例如表示候选裁剪的组合质量的参数。 参数还可以包括指示是否保存出现在场景中的内容的参数以及指示候选裁剪边界的简单性的参数。 基于分数,可以选择图像裁切,例如,将所选择的图像裁切呈现给用户进行选择。 要选择裁剪,可以根据分数进行排序,并选择不选择连续排序的裁剪。 或者或另外,可以根据指示这些裁剪具有不同视觉特征的分数在视觉上不同地选择图像裁切。

    Category Histogram Image Representation
    50.
    发明申请
    Category Histogram Image Representation 有权
    类别直方图图像表示

    公开(公告)号:US20150227817A1

    公开(公告)日:2015-08-13

    申请号:US14180305

    申请日:2014-02-13

    CPC classification number: G06K9/6212 G06K9/00664 G06K9/4642 G06K2009/6213

    Abstract: In techniques for category histogram image representation, image segments of an input image are generated and bounding boxes are selected that each represent a region of the input image, where each of the bounding boxes include image segments of the input image. A saliency map of the input image can also be generated. A bounding box is applied as a query on an images database to determine database image regions that match the region of the input image represented by the bounding box. The query can be augmented based on saliency detection of the input image region that is represented by the bounding box, and a query result is a ranked list of the database image regions. A category histogram for the region of the input image is then generated based on category labels of each of the database image regions that match the input image region.

    Abstract translation: 在类别直方图图像表示的技术中,生成输入图像的图像片段,并且选择每个表示输入图像的区域的边界框,其中每个边界框包括输入图像的图像片段。 也可以生成输入图像的显着图。 将边框应用于图像数据库上的查询,以确定与由边界框表示的输入图像的区域匹配的数据库图像区域。 可以基于由边界框表示的输入图像区域的显着性检测来增加查询,并且查询结果是数据库图像区域的排序列表。 然后基于与输入图像区域匹配的每个数据库图像区域的类别标签来生成输入图像的区域的类别直方图。

Patent Agency Ranking