公开(公告)号：US08938119B1

公开(公告)日：2015-01-20

申请号：US13461482

申请日：2012-05-01

申请人： Mei Han ,  Vivek Kwatra ,  Shengyang Dai ,  Sergey Ioffe

发明人： Mei Han ,  Vivek Kwatra ,  Shengyang Dai ,  Sergey Ioffe

IPC分类号： G06K9/00

CPC分类号： G06K9/4661 ,  G06T5/008

摘要： An image comprising color pixels with varying illumination is selected. Instances of a repeating pattern in the image are determined. Illumination values for illuminated pixels at locations within instances of the repeating pattern are calculated based on pixel intensities of non-illuminated pixels at corresponding locations in other instances of the repeating pattern. The illumination variation is removed from the illuminated pixels based on the calculated illumination values to produce enhanced pixels. Color from the non-illuminated pixels at the corresponding locations in other instances of the repeating pattern is propagated to the enhanced pixels.

摘要翻译： 选择包括具有变化的照明的彩色像素的图像。 确定图像中的重复图案的实例。 基于重复图案的其他实例中的相应位置处的非照明像素的像素强度来计算在重复图案的实例内的位置处的照明像素的照明值。 基于所计算的照明值，从照明像素去除照明变化以产生增强像素。 来自重复图案的其他实例中的相应位置处的非照明像素的颜色被传播到增强像素。

公开(公告)号：US08712930B1

公开(公告)日：2014-04-29

申请号：US13100872

申请日：2011-05-04

申请人： Michele Covell ,  Mei Han ,  Saurabh Mathur ,  Shumeet Baluja ,  Vivek Kwatra

发明人： Michele Covell ,  Mei Han ,  Saurabh Mathur ,  Shumeet Baluja ,  Vivek Kwatra

IPC分类号： G06F15/18

CPC分类号： G06K9/6202 ,  G06F17/30247 ,  G06K9/00684 ,  G06K9/4604 ,  G06K9/6267 ,  G06K9/6292 ,  G06K9/66 ,  G06T1/0021 ,  H04N19/105 ,  H04N19/17 ,  H04N19/189

摘要： An exemplar dictionary is built from exemplars of digital content for determining predictor blocks for encoding and decoding digital content. The exemplar dictionary organizes the exemplars as clusters of similar exemplars. Each cluster is mapped to a label. Machine learning techniques are used to generate a prediction model for predicting a label for an exemplar. The exemplar dictionary is used to encode digital content. Clusters of exemplars are obtained by applying a prediction model to a target block of digital content for encoding. A predictor block is selected for encoding the target block based on frequency of occurrence of exemplars in the clusters. The target block is encoded using the predictor block.

摘要翻译： 由数字内容的示例构建示范字典，用于确定用于对数字内容进行编码和解码的预测器块。 示范字典将样本组织成类似样本的集群。 每个集群映射到一个标签。 机器学习技术用于生成用于预测样本的标签的预测模型。 示范字典用于对数字内容进行编码。 通过将预测模型应用于用于编码的数字内容的目标块来获得样本簇。 基于群集中的样本的出现频率，选择预测块来对目标块进行编码。 使用预测器块对目标块进行编码。

公开(公告)号：US08867859B1

公开(公告)日：2014-10-21

申请号：US13610479

申请日：2012-09-11

申请人： Vivek Kwatra ,  Mei Han ,  Shengyang Dai

发明人： Vivek Kwatra ,  Mei Han ,  Shengyang Dai

IPC分类号： G06K9/40

CPC分类号： G06T5/008 ,  G06K9/2036 ,  G06K9/4661

摘要： An image comprising varying illumination is selected. Instances of a repeating pattern in the image is determined. Illumination values for pixels at locations within instances of the repeating pattern are calculated responsive to pixel intensities of pixels at corresponding locations in other instances of the repeating pattern. The varying illumination is removed form the image responsive to the illumination values.

摘要翻译： 选择包括变化照明的图像。 确定图像中重复图案的实例。 响应于重复图案的其他实例中的相应位置处的像素的像素强度来计算在重复图案的实例内的位置处的像素的照明值。 根据照明值从图像中去除变化的照明。

公开(公告)号：US08385662B1

公开(公告)日：2013-02-26

申请号：US12432989

申请日：2009-04-30

申请人： Sangho Yoon ,  Jay Yagnik ,  Mei Han ,  Vivek Kwatra

发明人： Sangho Yoon ,  Jay Yagnik ,  Mei Han ,  Vivek Kwatra

IPC分类号： G06K9/62

CPC分类号： G06K9/6247 ,  G06K9/6223

摘要： Clustering algorithms such as k-means clustering algorithm are used in applications that process entities with spatial and/or temporal characteristics, for example, media objects representing audio, video, or graphical data. Feature vectors representing characteristics of the entities are partitioned using clustering methods that produce results sensitive to an initial set of cluster seeds. The set of initial cluster seeds is generated using principal component analysis of either the complete feature vector set or a subset thereof. The feature vector set is divided into a desired number of initial clusters and a seed determined from each initial cluster.

摘要翻译： 诸如k均值聚类算法的聚类算法被用于处理具有空间和/或时间特征的实体的应用中，例如表示音频，视频或图形数据的媒体对象。 使用产生对初始集群种子集合敏感的结果的聚类方法对代表实体特征的特征向量进行分区。 使用完整特征向量集或其子集的主成分分析来生成初始簇种子集合。 特征向量集合被分为期望数量的初始簇和从每个初始簇确定的种子。

公开(公告)号：US20120141044A1

公开(公告)日：2012-06-07

申请号：US13308411

申请日：2011-11-30

申请人： Vivek Kwatra ,  Mei Han

发明人： Vivek Kwatra ,  Mei Han

IPC分类号： G06K9/36

CPC分类号： G06T5/008 ,  G06T2207/10032 ,  G06T2207/30181

摘要： An image comprising varying illumination is selected. Patches of pixels from among the plurality of pixels with the image are identified. Similarities between pairs of patches of pixels based on pixel intensities associated with the pairs of patches of pixels are calculated. Illumination values for the plurality of pixels within the image based on the calculated similarities between the pairs of patches of pixels is calculated. The illumination variation from the image is removed based on the calculated illumination values for the plurality of pixels within the image.

摘要翻译： 选择包括变化照明的图像。 识别具有图像的多个像素中的像素的补片。 计算基于与像素块对相关联的像素强度的像素块之间的相似性。 基于所计算的像素块对的相似度，计算图像内的多个像素的照明值。 基于图像内的多个像素的计算出的照明值来去除来自图像的照明变化。

公开(公告)号：US08805104B1

公开(公告)日：2014-08-12

申请号：US13105610

申请日：2011-05-11

申请人： Michele Covell ,  Vivek Kwatra ,  Mei Han ,  Saurabh Mathur ,  Shumeet Baluja

发明人： Michele Covell ,  Vivek Kwatra ,  Mei Han ,  Saurabh Mathur ,  Shumeet Baluja

IPC分类号： G06K9/36

CPC分类号： H04N19/97

摘要： An image processing system is provided for encoding images based on example-based compression. The system selects a set of candidate dictionary predictor entries to encode a portion of an image based at least in part on the neighbors of the portion. The spatial continuity between portions of the image is exploited by the image processing system by selecting corresponding dictionary predictor entries that have the same offset vector as the portion of the image and its neighboring portions.

摘要翻译： 提供了一种基于基于实例的压缩来对图像进行编码的图像处理系统。 该系统至少部分地基于该部分的邻居来选择一组候选词典预测变量条目以对图像的一部分进行编码。 图像部分之间的空间连续性由图像处理系统通过选择与图像及其相邻部分具有相同偏移矢量的相应词典预测词条来利用。

公开(公告)号：US08798393B2

公开(公告)日：2014-08-05

申请号：US13308411

申请日：2011-11-30

申请人： Vivek Kwatra ,  Mei Han

发明人： Vivek Kwatra ,  Mei Han

IPC分类号： G06K9/40

CPC分类号： G06T5/008 ,  G06T2207/10032 ,  G06T2207/30181

摘要： An image comprising varying illumination is selected. Patches of pixels from among the plurality of pixels with the image are identified. Similarities between pairs of patches of pixels based on pixel intensities associated with the pairs of patches of pixels are calculated. Illumination values for the plurality of pixels within the image based on the calculated similarities between the pairs of patches of pixels is calculated. The illumination variation from the image is removed based on the calculated illumination values for the plurality of pixels within the image.

摘要翻译： 选择包括变化照明的图像。 识别具有图像的多个像素中的像素的补片。 计算基于与像素块对相关联的像素强度的像素块之间的相似性。 基于所计算的像素块对的相似度，计算图像内的多个像素的照明值。 基于图像内的多个像素的计算出的照明值来去除来自图像的照明变化。

公开(公告)号：US08724701B1

公开(公告)日：2014-05-13

申请号：US13088856

申请日：2011-04-18

申请人： Michele Covell ,  Vivek Kwatra ,  Mei Han ,  Saurabh Mathur ,  Shumeet Baluja

发明人： Michele Covell ,  Vivek Kwatra ,  Mei Han ,  Saurabh Mathur ,  Shumeet Baluja

IPC分类号： H04N7/12 ,  H04N11/02

CPC分类号： H04N19/23 ,  H04N19/94

摘要： An image processing system is provided for encoding videos based on example-based compression. To select the dictionary predictor entries to encode a video, the image processing system reduces the complexity of the video by decomposing the video into smaller pieces. By breaking the video into the simpler pieces, it is easier to locate dictionary predictor entries that are similar to the pieces of the video. The image processing system may decompose the video into one more space-time tubes. For each space-time tube, the image processing system selects dictionary predictor entries to encode the tube.

摘要翻译： 提供了一种基于基于实例的压缩来对视频进行编码的图像处理系统。 为了选择字典预测器条目来编码视频，图像处理系统通过将视频分解成较小的部分来降低视频的复杂性。 通过将视频分解成更简单的部分，可以更容易地找到类似于视频片段的字典预测变量条目。 图像处理系统可以将视频分解成更多的时空管。 对于每个时空管，图像处理系统选择字典预测器条目来对管进行编码。

公开(公告)号：US08611695B1

公开(公告)日：2013-12-17

申请号：US12430791

申请日：2009-04-27

申请人： Mei Han ,  Vivek Kwatra ,  Hui Fang

发明人： Mei Han ,  Vivek Kwatra ,  Hui Fang

IPC分类号： G06K9/36

CPC分类号： G06K9/4642 ,  G06F17/30247 ,  G06K9/00677

摘要： An image processing server enhances an original image using image data from other images. The server generates global descriptors of a set of received images and creates an image data structure therefrom. The server also identifies a set of patches for each of the received images, generates descriptors of the patches, and generates a patch data structure therefrom. The image processing system identifies a patch in an original image for which enhancement is desired. The image processing server uses a global descriptor of the original image to search the image data structure for a set of related images that are visually similar to the original image. The image processing server uses a patch descriptor of the patch for which enhancement is desired to search the patch data structures for the related images to identify a set of patches that are visually similar to the patch in the original image.

摘要翻译： 图像处理服务器使用来自其他图像的图像数据增强原始图像。 服务器生成一组接收图像的全局描述符，并从中创建一个图像数据结构。 服务器还识别每个接收到的图像的一组补丁，生成补丁的描述符，并从中生成补丁数据结构。 图像处理系统识别需要增强的原始图像中的贴片。 图像处理服务器使用原始图像的全局描述符来搜索与原始图像在视觉上类似的一组相关图像的图像数据结构。 图像处理服务器使用需要增强的补丁的补丁描述符来搜索补丁数据结构中的相关图像，以识别在视觉上与原始图像中的补丁相似的一组补丁。

公开(公告)号：US08571349B1

公开(公告)日：2013-10-29

申请号：US13619624

申请日：2012-09-14

申请人： Vivek Kwatra ,  Mei Han ,  Jay N. Yagnik

发明人： Vivek Kwatra ,  Mei Han ,  Jay N. Yagnik

IPC分类号： G06K9/36

CPC分类号： G06T7/33

摘要： An image processing system enhances the resolution of an original image using higher-resolution image data from other images. The image processing system defines a plurality of overlapping partitions for the original image, each partition defining a set of non-overlapping site patches. During an optimization phase, the system identifies, for site patches of the original images, label patches within related images that are of most relevance. During a rendering phase independent of the optimization phase, an output image with enhanced resolution is synthesized by substituting, for site patches of the original image, the identified relevant label patches from the related images.