Iterative patch-based image upscaling

    公开(公告)号:US09984440B2

    公开(公告)日:2018-05-29

    申请号:US13920957

    申请日:2013-06-18

    Abstract: Image upscaling techniques are described. These techniques may include use of iterative and adjustment upscaling techniques to upscale an input image. A variety of functionality may be incorporated as part of these techniques, examples of which include content-adaptive patch finding techniques that may be employed to give preference to an in-place patch to minimize structure distortion. In another example, content metric techniques may be employed to assign weights for combining patches. In a further example, algorithm parameters may be adapted with respect to algorithm iterations, which may be performed to increase efficiency of computing device resource utilization and speed of performance. For instance, algorithm parameters may be adapted to enforce a minimum and/or maximum number to iterations, cease iterations for image sizes over a threshold amount, set sampling step sizes for patches, employ techniques based on color channels (which may include independence and joint processing techniques), and so on.

    Content update suggestions
    2.
    发明授权

    公开(公告)号:US09818044B2

    公开(公告)日:2017-11-14

    申请号:US14938781

    申请日:2015-11-11

    CPC classification number: G06K9/6202 G06K9/6201 G06K9/80 G06T11/60 G06T2200/24

    Abstract: Content update and suggestion techniques are described. In one or more implementations, techniques are implemented to generate suggestions that are usable to guide creative professionals in updating content such as images, video, sound, multimedia, and so forth. A variety of techniques are usable to generate suggestions for the content professionals. In one example, suggestions are based on shared characteristics of images licensed by users of a content sharing service, e.g., licensed by the users. In another example, suggestions are based on metadata of the images licensed by the users, the metadata describing characteristics of how the images are created. These suggestions are then used to guide transformation of a user's image such that the image exhibits these characteristics and thus has an increased likelihood of being desired for licensing by customers of the service.

    Content Update Suggestions
    3.
    发明申请

    公开(公告)号:US20170132490A1

    公开(公告)日:2017-05-11

    申请号:US14938781

    申请日:2015-11-11

    CPC classification number: G06K9/6202 G06K9/6201 G06K9/80 G06T11/60 G06T2200/24

    Abstract: Content update and suggestion techniques are described. In one or more implementations, techniques are implemented to generate suggestions that are usable to guide creative professionals in updating content such as images, video, sound, multimedia, and so forth. A variety of techniques are usable to generate suggestions for the content professionals. In one example, suggestions are based on shared characteristics of images licensed by users of a content sharing service, e.g., licensed by the users. In another example, suggestions are based on metadata of the images licensed by the users, the metadata describing characteristics of how the images are created. These suggestions are then used to guide transformation of a user's image such that the image exhibits these characteristics and thus has an increased likelihood of being desired for licensing by customers of the service.

    Belief propagation and affinity measures
    4.
    发明授权
    Belief propagation and affinity measures 有权
    信仰传播和亲和力措施

    公开(公告)号:US09214026B2

    公开(公告)日:2015-12-15

    申请号:US13722825

    申请日:2012-12-20

    Abstract: Belief propagation and affinity measure techniques are described. In one or more implementations, beliefs may be formed to solve a labeling problem for a node, such as to perform image processing. An affinity measure may be calculated that describes how similar the node is to another node. This affinity measure may then be used as a basis to determine whether the share the belief formed for the node with the other node to solve a labeling problem for the other node.

    Abstract translation: 描述信仰传播和亲和力测量技术。 在一个或多个实现中,可以形成信念来解决节点的标签问题,例如执行图像处理。 可以计算亲和力度量,描述节点与另一个节点的相似度。 然后,该亲和测度可以用作基础,以确定共享对于具有另一个节点的节点形成的信念是否解决另一个节点的标签问题。

    Spatially coherent nearest neighbor fields
    5.
    发明授权
    Spatially coherent nearest neighbor fields 有权
    空间相干最近邻域

    公开(公告)号:US09025822B2

    公开(公告)日:2015-05-05

    申请号:US13794125

    申请日:2013-03-11

    Abstract: In embodiments of spatially coherent nearest neighbor fields, initial matching patches of a nearest neighbor field can be determined at image grid locations of a first digital image and a second digital image. Spatial coherency can be enforced for each matching patch in the second digital image with reference to respective matching patches in the first digital image based on motion data of neighboring matching patches. A multi-resolution iterative process can then update each spatially coherent matching patch based on overlapping grid regions of the matching patches that are evaluated for matching regions of the first and second digital images. An optimal, spatially coherent matching patch can be selected for each of the image grid locations of the first and second digital images based on iterative interaction to enforce the spatial coherency of each matching patch and the multi-resolution iterative process to update each spatially coherent matching patch.

    Abstract translation: 在空间相干最近邻域的实施例中,可以在第一数字图像和第二数字图像的图像网格位置处确定最近邻域的初始匹配块。 基于相邻匹配补丁的运动数据,参考第一数字图像中的相应匹配补丁,可以针对第二数字图像中的每个匹配补丁实施空间一致性。 然后,多分辨率迭代过程可以基于为第一和第二数字图像的匹配区域评估的匹配块的重叠网格区域来更新每个空间相干匹配块。 可以基于迭代交互来选择针对第一和第二数字图像的每个图像网格位置的最佳空间相干匹配块,以强制每个匹配块的空间一致性和多分辨率迭代过程以更新每个空间相干匹配 补丁。

    Stereoscopic Target Region Filling
    6.
    发明申请
    Stereoscopic Target Region Filling 有权
    立体目标区域填充

    公开(公告)号:US20140313187A1

    公开(公告)日:2014-10-23

    申请号:US13866632

    申请日:2013-04-19

    CPC classification number: H04N13/111

    Abstract: Stereoscopic target region filling techniques are described. Techniques are described in which stereo consistency is promoted between target regions, such as by sharing information during computation. Techniques are also described in which target regions of respective disparity maps are completed to promote consistency between the disparity maps. This estimated disparity may then be used as a guide to completion of a missing texture in the target region. Techniques are further described in which cross-image searching and matching is employed by leveraging a plurality of images. This may including giving preference to matches with cross-image consistency to promote consistency, thereby enforcing stereo consistency between stereo images when applicable.

    Abstract translation: 描述了立体目标区填充技术。 描述了在目标区域之间促进立体一致性的技术,例如通过在计算期间共享信息。 还描述了其中完成各个视差图的目标区域以促进视差图之间的一致性的技术。 然后可以将该估计的差异用作在目标区域中完成缺失纹理的指导。 进一步描述了通过利用多个图像来采用跨图像搜索和匹配的技术。 这可能包括优先考虑与跨图像一致性的匹配以促进一致性,从而在适用时实现立体图像之间的立体一致性。

    Methods and Apparatus for Correcting Disparity Maps using Statistical Analysis on Local Neighborhoods
    7.
    发明申请
    Methods and Apparatus for Correcting Disparity Maps using Statistical Analysis on Local Neighborhoods 有权
    使用地方社区统计分析校正差距图的方法和装置

    公开(公告)号:US20130136338A1

    公开(公告)日:2013-05-30

    申请号:US13675905

    申请日:2012-11-13

    Abstract: Methods and apparatus for disparity map correction through statistical analysis on local neighborhoods. A disparity map correction technique may be used to correct mistakes in a disparity or depth map. The disparity map correction technique may detect and mark invalid pixel pairs in a disparity map, segment the image, and perform a statistical analysis of the disparities in each segment to identify outliers. The invalid and outlier pixels may then be corrected using other disparity values in the local neighborhood. Multiple iterations of the disparity map correction technique may be performed to further improve the output disparity map.

    Abstract translation: 通过对当地社区进行统计分析的视差图校正方法和装置。 视差图校正技术可用于纠正视差或深度图中的错误。 视差图校正技术可以检测和标记视差图中的无效像素对,对图像进行分段,并对每个段中的差异进行统计分析以识别异常值。 然后可以使用本地邻域中的其他视差值来校正无效和异常值像素。 可以执行视差图校正技术的多次迭代以进一步改善输出视差图。

    Content sharing collections and navigation

    公开(公告)号:US10198590B2

    公开(公告)日:2019-02-05

    申请号:US14938724

    申请日:2015-11-11

    Abstract: Content creation collection and navigation techniques and systems are described. In one example, a representative image is used by a content sharing service to interact with a collection of images provided as part of a search result. In another example, a user interface image navigation control is configured to support user navigation through images based on one or more metrics. In a further example, a user interface image navigation control is configured to support user navigation through images based on one or more metrics identified for an object selected from the image. In yet another example, collections of images are leveraged as part of content creation. In another example, data obtained from a content sharing service is leveraged to indicate suitability of images of a user for licensing as part of the service.

Patent Agency Ranking