公开(公告)号：US09122960B2

公开(公告)日：2015-09-01

申请号：US13691212

申请日：2012-11-30

Applicant: Adobe Systems Incorporated

Inventor： Zhe Lin ,  Xin Lu ,  Jonathan Brandt ,  Hailin Jin

IPC: G06K9/00 ,  G06K9/62 ,  G06K9/40 ,  G06K9/68 ,  G06T5/00

CPC classification number: G06K9/68 ,  G06T5/001 ,  G06T2207/20021

Abstract: Systems and methods are provided for providing patch size adaptation for patch-based image enhancement operations. In one embodiment, an image manipulation application receives an input image. The image manipulation application compares a value for an attribute of at least one input patch of the input image to a threshold value. Based on comparing the value for the to the threshold value, the image manipulation application adjusts a first patch size of the input patch to a second patch size that improves performance of a patch-based image enhancement operation as compared to the first patch size. The image manipulation application performs the patch-based image enhancement operation based on one or more input patches of the input image having the second patch size.

Abstract translation: 提供了系统和方法，用于为基于贴片的图像增强操作提供补丁大小适应。 在一个实施例中，图像处理应用接收输入图像。 图像处理应用将输入图像的至少一个输入片段的属性的值与阈值进行比较。 基于比较阈值的值，图像处理应用程序将输入补丁的第一补丁大小调整为与第一补丁大小相比提高基于补丁的图像增强操作的性能的第二补丁大小。 图像处理应用程序基于具有第二补丁大小的输入图像的一个或多个输入补丁执行基于补丁的图像增强操作。

公开(公告)号：US20150139557A1

公开(公告)日：2015-05-21

申请号：US14085488

申请日：2013-11-20

Applicant: Adobe Systems Incorporated

Inventor： Zhe Lin ,  Jianchao Yang ,  Hailin Jin ,  Xin Lu

IPC: G06K9/62

CPC classification number: G06K9/4642 ,  G06K9/6273 ,  G06K9/6276

Abstract: In techniques for fast dense patch search and quantization, partition center patches are determined for partitions of example image patches. Patch groups of an image each include similar image patches and a reference image patch that represents a respective patch group. A partition center patch of the partitions is determined as a nearest neighbor to the reference image patch of a patch group. The partition center patch can be determined based on a single-nearest neighbor (1-NN) distance determination, and the determined partition center patch is allocated as the nearest neighbor to the similar image patches in the patch group. Alternatively, a group of nearby partition center patches are determined as the nearest neighbors to the reference image patch based on a k-nearest neighbor (k-NN) distance determination, and the nearest neighbor to each of the similar image patches in the patch group is determined from the nearby partition center patches.

Abstract translation: 在快速密集补丁搜索和量化的技术中，为示例图像补丁的分区确定分区中心补丁。 图像的补丁组各自包括相似的图像补丁和代表相应补丁组的参考图像补丁。 分区的分区中心补丁被确定为补丁组的参考图像补丁的最近邻。 可以基于单个最近邻居（1-NN）距离确定来确定分区中心补丁，并且将所确定的分区中心补丁分配为补丁组中的相似图像补丁的最近邻。 或者，基于k个最近邻（k-NN）距离确定，将一组附近的分区中心补丁确定为参考图像补丁的最近邻，并且补丁组中每个相似图像补丁的最近邻 是从附近的分区中心补丁确定的。

公开(公告)号：US20150139538A1

公开(公告)日：2015-05-21

申请号：US14081489

申请日：2013-11-15

Applicant: Adobe Systems Incorporated

Inventor： Zhe Lin ,  Jonathan W. Brandt ,  Xiaohui Shen ,  Haoxiang Li

IPC: G06K9/62 ,  G06K9/00

CPC classification number: G06K9/6269 ,  G06K9/00234 ,  G06K9/00288 ,  G06K9/6257

Abstract: In techniques for object detection with boosted exemplars, weak classifiers of a real-adaboost technique can be learned as exemplars that are collected from example images. The exemplars are examples of an object that is detectable in image patches of an image, such as faces that are detectable in images. The weak classifiers of the real-adaboost technique can be applied to the image patches of the image, and a confidence score is determined for each of the weak classifiers as applied to an image patch of the image. The confidence score of a weak classifier is an indication of whether the object is detected in the image patch of the image based on the weak classifier. All of the confidence scores of the weak classifiers can then be summed to generate an overall object detection score that indicates whether the image patch of the image includes the object.

Abstract translation: 在通过增强的样本进行物体检测的技术中，可以从实例图像中收集真实adaboost技术的弱分类器作为样本。 示例是在图像的图像块中可检测到的对象的示例，例如在图像中可检测的面。 真实adaboost技术的弱分类器可以应用于图像的图像斑块，并且对于每个弱分类器确定应用于图像的图像块的置信度分数。 弱分类器的置信度分数是基于弱分类器在图像的图像块中是否检测到对象的指示。 然后可以将弱分类器的所有置信分数相加以生成指示图像的图像块是否包括对象的整体对象检测分数。

公开(公告)号：US20140368549A1

公开(公告)日：2014-12-18

申请号：US13920911

申请日：2013-06-18

Applicant: Adobe Systems Incorporated

Inventor： Zhe Lin ,  Jianchao Yang ,  Scott D. Cohen

IPC: G06T3/40

CPC classification number: G06T3/40 ,  G06T3/4076

Abstract: Image upscaling techniques are described. These techniques may include use of iterative and adjustment upscaling techniques to upscale an input image. A variety of functionality may be incorporated as part of these techniques, examples of which include content-adaptive patch finding techniques that may be employed to give preference to an in-place patch to minimize structure distortion. In another example, content metric techniques may be employed to assign weights for combining patches. In a further example, algorithm parameters may be adapted with respect to algorithm iterations, which may be performed to increase efficiency of computing device resource utilization and speed of performance. For instance, algorithm parameters may be adapted to enforce a minimum and/or maximum number to iterations, cease iterations for image sizes over a threshold amount, set sampling step sizes for patches, employ techniques based on color channels (which may include independence and joint processing techniques), and so on.

Abstract translation: 描述了图像升高技术。 这些技术可以包括使用迭代和调整放大技术来升高输入图像。 作为这些技术的一部分，可以并入各种功能，其示例包括可用于优先使用就地补丁以最小化结构失真的内容自适应补片发现技术。 在另一示例中，可以采用内容度量技术来分配用于组合补丁的权重。 在另一示例中，算法参数可以针对算法迭代进行调整，这可以被执行以提高计算设备资源利用率和性能的效率。 例如，算法参数可以适于对迭代执行最小和/或最大数量，停止针对阈值量的图像大小的迭代，设置用于补丁的采样步长，采用基于颜色通道的技术（其可以包括独立性和联合 处理技术）等。

公开(公告)号：US20140355899A1

公开(公告)日：2014-12-04

申请号：US13904947

申请日：2013-05-29

Applicant: Adobe Systems Incorporated

Inventor： Hailin Jin ,  Scott David Cohen ,  Zhe Lin

IPC: G06T5/00

CPC classification number: G06T5/005 ,  G06T5/002 ,  G06T2207/10016 ,  G06T2207/20072

Abstract: A method and systems of enhancing a video using a related image are provided. One or more patches are identified in the video, with each patch identifying a region that is present in one of the frames of the video that can be mapped to a similar region in at least one other frame of the video. For each identified patch in the video, a best matching patch in the related image is found. The video is enhanced using the best matching patch in the related image for each identified patch in the video.

Abstract translation: 提供了使用相关图像来增强视频的方法和系统。 在视频中识别一个或多个补丁，其中每个补丁标识存在于视频的一个帧中的区域，该区域可以被映射到视频的至少一个其他帧中的类似区域。 对于视频中的每个识别的补丁，找到相关图像中的最佳匹配补丁。 使用视频中每个已识别的补丁的相关图像中的最佳匹配补丁来增强视频。

公开(公告)号：US20140147022A1

公开(公告)日：2014-05-29

申请号：US13686737

申请日：2012-11-27

Applicant: Adobe Systems Incorporated

Inventor： Feng Zhou ,  Jon Brandt ,  Zhe Lin

IPC: G06K9/00

CPC classification number: G06K9/00281

Abstract: Systems and methods are discussed to localize facial landmarks using a test facial image and a set of training images. The landmarks can be localized on a test facial image using training facial images. A plurality of candidate landmark locations on the test facial image can be determined. A subset of the training facial images with facial features similar to the facial features in the test facial image can be identified. A plurality of shape constraints can be determined for each test facial image in the subset of test facial images. These shape constraints graphically relate to one landmark location from a linear combination of the other landmark locations in the test facial image. Shape constraints can be determined for every landmark within each test facial image. A candidate landmark can be chosen from the plurality of candidate landmarks using the shape constraints.

Abstract translation: 讨论系统和方法以使用测试面部图像和一组训练图像来定位面部地标。 可以使用训练面部图像将地标定位在测试面部图像上。 可以确定测试面部图像上的多个候选标记位置。 可以识别训练面部图像的一部分，其面部特征与测试面部图像中的面部特征相似。 可以在测试面部图像的子集中的每个测试面部图像确定多个形状约束。 这些形状约束图形地涉及来自测试面部图像中的其他地标位置的线性组合的一个地标位置。 每个测试面部图像中的每个地标可以确定形状约束。 可以使用形状约束从多个候选地标中选择候选地标。

公开(公告)号：US20140099031A1

公开(公告)日：2014-04-10

申请号：US13645463

申请日：2012-10-04

Applicant: ADOBE SYSTEMS INCORPORATED

Inventor： Jonathan W. Brandt ,  Zhe Lin ,  Vuong Le ,  Lubomir D. Bourdev

IPC: G06K9/46

CPC classification number: G06K9/6209 ,  G06K9/00228 ,  G06K9/2081 ,  G06K2009/366

Abstract: Various embodiments of methods and apparatus for feature point localization are disclosed. A profile model and a shape model may be applied to an object in an image to determine locations of feature points for each object component. Input may be received to move one of the feature points to a fixed location. Other ones of the feature points may be automatically adjusted to different locations based on the moved feature point.

Abstract translation: 公开了用于特征点定位的方法和装置的各种实施例。 轮廓模型和形状模型可以应用于图像中的对象，以确定每个对象分量的特征点的位置。 可以接收输入以将特征点中的一个移动到固定位置。 其他特征点可以根据所移动的特征点自动调整到不同的位置。

公开(公告)号：US10257436B1

公开(公告)日：2019-04-09

申请号：US15730632

申请日：2017-10-11

Applicant: Adobe Systems Incorporated

Inventor： Jianming Zhang ,  Zijun Wei ,  Zhe Lin ,  Xiaohui Shen ,  Radomir Mech

IPC: H04N5/262 ,  G06K9/00 ,  G06N99/00 ,  H04N5/222

Abstract: Various embodiments describe view switching of video on a computing device. In an example, a video processing application receives a stream of video data. The video processing application renders a major view on a display of the computing device. The major view presents a video from the stream of video data. The video processing application inputs the stream of video data to a deep learning system and receives back information that identifies a cropped video from the video based on a composition score of the cropped video, while the video is presented in the major view. The composition score is generated by the deep learning system. The video processing application renders a sub-view on a display of the device, the sub-view presenting the cropped video. The video processing application renders the cropped video in the major view based on a user interaction with the sub-view.

公开(公告)号：US20190019052A1

公开(公告)日：2019-01-17

申请号：US15650669

申请日：2017-07-14

Applicant: Adobe Systems Incorporated

Inventor： I-Ming Pao ,  Jue Wang ,  Ke Ma ,  Zhe Lin

IPC: G06K9/32 ,  G06K9/00 ,  G06K9/36 ,  G06K9/46 ,  G06T11/60

CPC classification number: G06K9/00456 ,  G06K9/3258

Abstract: Text region detection techniques and systems for digital images using image tag filtering are described. These techniques and systems support numerous advantages over conventional techniques through use of image tags to filter text region candidates. A computing device, for instance, may first generate text region candidates through use of a variety of different techniques, such as text line detection. The computing device then assigns image tags to the text region candidates. The assigned image tags are then used by the computing device to filter the text region candidates based on whether image tags assigned to respective candidates are indicative of text.

公开(公告)号：US20180374199A1

公开(公告)日：2018-12-27

申请号：US16119709

申请日：2018-08-31

Applicant: Adobe Systems Incorporated

Inventor： Xiaohui Shen ,  Yi-Hsuan Tsai ,  Kalyan K. Sunkavalli ,  Zhe Lin

IPC: G06T5/00 ,  G06T7/90 ,  G06F17/30 ,  G06T11/00 ,  G06F3/0482 ,  G06F3/0484

Abstract: Embodiments of the present disclosure relate to a sky editing system and related processes for sky editing. The sky editing system includes a composition detector to determine the composition of a target image. A sky search engine in the sky editing system is configured to find a reference image with similar composition with the target image. Subsequently, a sky editor replaces content of the sky in the target image with content of the sky in the reference image. As such, the sky editing system transforms the target image into a new image with a preferred sky background.