公开(公告)号：US08874557B2

公开(公告)日：2014-10-28

申请号：US13552595

申请日：2012-07-18

Applicant: Zhe Lin ,  Jonathan W. Brandt ,  Xiaohui Shen

Inventor： Zhe Lin ,  Jonathan W. Brandt ,  Xiaohui Shen

IPC: G06F17/30 ,  G06F7/00 ,  G06K9/46 ,  G06K9/62 ,  G06Q30/02

CPC classification number: G06F17/30259 ,  G06F17/3025 ,  G06F17/30256 ,  G06F17/30262 ,  G06F17/30265 ,  G06F17/3028 ,  G06K9/4676 ,  G06K9/6211 ,  G06K9/6212 ,  G06Q30/02

Abstract: Methods, apparatus, and computer-readable storage media for object retrieval and localization that employ a spatially-constrained similarity model. A spatially-constrained similarity measure may be evaluated by a voting-based scoring technique. Object retrieval and localization may thus be achieved without post-processing. The spatially-constrained similarity measure may handle object rotation, scaling and view point change. The similarity measure can be efficiently calculated by the voting-based method and integrated with inverted files. The voting-based scoring technique may simultaneously retrieve and localize a query object in a collection of images such as an image database. The object retrieval and localization technique may, for example, be implemented with a k-nearest neighbor (k-NN) re-ranking method in or as a retrieval method, system or module. The k-NN re-ranking method may be applied to improve query results of the object retrieval and localization technique.

Abstract translation: 用于采用空间约束相似性模型的对象检索和定位的方法，装置和计算机可读存储介质。 空间约束的相似性度量可以通过基于投票的评分技术来评估。 因此可以在不进行后处理的情况下实现对象检索和定位。 空间约束的相似性度量可以处理对象旋转，缩放和观察点变化。 相似性度量可以通过基于投票的方法有效地计算并与反转文件集成。 基于投票的评分技术可以同时检索和定位诸如图像数据库的图像集合中的查询对象。 对象检索和定位技术可以例如在k取最近邻（k-NN）重排序方法中，或者作为检索方法，系统或模块来实现。 可以应用k-NN重排法来改善对象检索和定位技术的查询结果。

公开(公告)号：US08811686B2

公开(公告)日：2014-08-19

申请号：US13563606

申请日：2012-07-31

Applicant: Jonathan W. Brandt ,  Zhe Lin ,  Vuong Le

Inventor： Jonathan W. Brandt ,  Zhe Lin ,  Vuong Le

IPC: G06K9/00 ,  G06K9/40 ,  G06K9/36 ,  G06T5/00

CPC classification number: G06K9/00248 ,  G06T5/005

Abstract: Various embodiments of methods and apparatus for facial retouching are disclosed. In one embodiment, a face in an input image is detected. Independent sets of feature points are detected for respective facial feature components. A plurality of masks for each of the facial feature components is generated. Using the plurality of masks, retouch effects are performed to the facial feature components. Some embodiments provide for user interaction to constrain the mask generation.

Abstract translation: 公开了用于面部修饰的方法和装置的各种实施例。 在一个实施例中，检测输入图像中的脸部。 针对各个面部特征部件检测独立的特征点组。 产生用于每个面部特征部件的多个掩模。 使用多个掩模，对面部特征部件执行润饰效果。 一些实施例提供用户交互来约束掩模生成。

公开(公告)号：US20130044947A1

公开(公告)日：2013-02-21

申请号：US13563606

申请日：2012-07-31

Applicant: Jonathan W. Brandt ,  Zhe Lin ,  Vuong Le

Inventor： Jonathan W. Brandt ,  Zhe Lin ,  Vuong Le

IPC: G06T5/00 ,  G06K9/46

CPC classification number: G06K9/00248 ,  G06T5/005

Abstract: Various embodiments of methods and apparatus for facial retouching are disclosed. In one embodiment, a face in an input image is detected. Independent sets of feature points are detected for respective facial feature components. A plurality of masks for each of the facial feature components is generated. Using the plurality of masks, retouch effects are performed to the facial feature components. Some embodiments provide for user interaction to constrain the mask generation.

Abstract translation: 公开了用于面部修饰的方法和装置的各种实施例。 在一个实施例中，检测输入图像中的脸部。 针对各个面部特征部件检测独立的特征点组。 产生用于每个面部特征部件的多个掩模。 使用多个掩模，对面部特征部件执行润饰效果。 一些实施例提供用户交互来约束掩模生成。

公开(公告)号：US09087390B2

公开(公告)日：2015-07-21

申请号：US13481477

申请日：2012-05-25

Applicant: Hailin Jin ,  Alper Ayvaci ,  Zhe Lin ,  Scott D. Cohen

Inventor： Hailin Jin ,  Alper Ayvaci ,  Zhe Lin ,  Scott D. Cohen

IPC: G06K9/40 ,  G06T3/40

CPC classification number: G06T3/4053 ,  G06T3/4076 ,  G06T5/002

Abstract: A method, system, and computer-readable storage medium are disclosed for upscaling an image sequence. An upsampled frame is generated based on an original frame in an original image sequence comprising a plurality of frames. A smoothed image sequence is generated based on the original image sequence. A plurality of patches are determined in the upsampled frame. Each patch comprises a subset of image data in the upsampled frame. Locations of a plurality of corresponding patches are determined in a neighboring set of the plurality of frames in the smoothed image sequence. A plurality of high-frequency patches are generated. Each high-frequency patch is based on image data at the locations of the corresponding patches in the original image sequence. The plurality of high-frequency patches are added to the upsampled frame to generate a high-quality upscaled frame.

Abstract translation: 公开了一种用于升高图像序列的方法，系统和计算机可读存储介质。 基于包括多个帧的原始图像序列中的原始帧生成上采样帧。 基于原始图像序列生成平滑图像序列。 在上采样帧中确定多个补丁。 每个贴片包括上采样帧中的图像数据的子集。 在平滑图像序列中的多个帧的相邻集合中确定多个对应的片段的位置。 产生多个高频补丁。 每个高频片基于原始图像序列中相应片段位置处的图像数据。 将多个高频贴片添加到上采样帧以产生高质量的放大的帧。

公开(公告)号：US08983940B2

公开(公告)日：2015-03-17

申请号：US13552596

申请日：2012-07-18

Applicant: Zhe Lin ,  Jonathan W. Brandt ,  Xiaohui Shen

Inventor： Zhe Lin ,  Jonathan W. Brandt ,  Xiaohui Shen

IPC: G06F17/30 ,  G06F7/00 ,  G06K9/46 ,  G06K9/62 ,  G06Q30/02

CPC classification number: G06F17/30259 ,  G06F17/3025 ,  G06F17/30256 ,  G06F17/30262 ,  G06F17/30265 ,  G06F17/3028 ,  G06K9/4676 ,  G06K9/6211 ,  G06K9/6212 ,  G06Q30/02

Abstract: Methods, apparatus, and computer-readable storage media for k-NN re-ranking. Based on retrieved images and localized objects, a k-NN re-ranking method may use the k-nearest neighbors of a query to refine query results. Given the top k retrieved images and their localized objects, each k-NN object may be used as a query to perform a search. A database image may have different ranks when using those k-nearest neighbors as queries. Accordingly, a new score for each database image may be collaboratively determined by those ranks, and re-ranking may be performed using the new scores to improve the search results. The k-NN re-ranking technique may be performed two or more times, each time on a new set of k-nearest neighbors, to further refine the search results.

Abstract translation: 用于k-NN重新排序的方法，装置和计算机可读存储介质。 基于检索到的图像和本地化对象，k-NN重排序方法可以使用查询的k个最近邻居来优化查询结果。 给定顶部k个检索到的图像及其本地化对象，每个k-NN对象可以用作查询来执行搜索。 当使用这些k个最近邻居作为查询时，数据库图像可能具有不同的等级。 因此，每个数据库图像的新分数可以由这些等级协同确定，并且可以使用新分数来执行重新排序以改善搜索结果。 k-NN重新排序技术可以每次在一组新的k个最近邻居上执行两次或更多次，以进一步优化搜索结果。

公开(公告)号：US08824808B2

公开(公告)日：2014-09-02

申请号：US13563556

申请日：2012-07-31

Applicant: Jonathan W. Brandt ,  Zhe Lin ,  Vuong Le

Inventor： Jonathan W. Brandt ,  Zhe Lin ,  Vuong Le

IPC: G06K9/46 ,  G06K9/50

CPC classification number: G06K9/00248 ,  G06T5/005

Abstract: Various embodiments of methods and apparatus for facial retouching are disclosed. In one embodiment, a face in an input image is detected. One or more transformation parameters for the detected face are estimated based on a profile model. The profile model is applied to obtain a set of feature points for each facial component of the detected face. Global and component-based shape models are applied to generate feature point locations of each facial component of the detected face.

Abstract translation: 公开了用于面部修饰的方法和装置的各种实施例。 在一个实施例中，检测输入图像中的脸部。 基于轮廓模型估计检测到的面部的一个或多个变换参数。 应用轮廓模型以获得检测到的面部的每个面部分量的一组特征点。 应用全局和基于组件的形状模型来生成检测到的面部的每个面部组件的特征点位置。

公开(公告)号：US08781255B2

公开(公告)日：2014-07-15

申请号：US13434028

申请日：2012-03-29

Applicant: Zhe Lin ,  Jonathan W. Brandt

Inventor： Zhe Lin ,  Jonathan W. Brandt

IPC: G06K9/00

CPC classification number: G06F17/30262 ,  G06F17/3025 ,  G06K9/4676

Abstract: Each image of a set of images is characterized with a set of sparse feature descriptors and a set of dense feature descriptors. In some embodiments, both the set of sparse feature descriptors and the set of dense feature descriptors are calculated based on a fixed rotation for computing texture descriptors, while color descriptors are rotation invariant. In some embodiments, the descriptors of both sparse and dense features are then quantized into visual words. Each database image is represented by a feature index including the visual words computed from both sparse and dense features. A query image is characterized with the visual words computed from both sparse and dense features of the query image. A rotated local Bag-of-Features (BoF) operation is performed upon a set of rotated query images against the set of database images. Each of the set of images is ranked based on the rotated local Bag-of-Features operation.

Abstract translation: 一组图像的每个图像用一组稀疏特征描述符和一组密集特征描述符来表征。 在一些实施例中，基于用于计算纹理描述符的固定旋转来计算稀疏特征描述符集合和密集特征描述符集合，而颜色描述符是旋转不变量。 在一些实施例中，稀疏和密集特征的描述符然后被量化为视觉词。 每个数据库图像由特征索引表示，包括从稀疏和密集特征计算的视觉词。 查询图像的特征在于从查询图像的稀疏和密集特征计算的视觉词。 一组旋转的本地特征（BoF）操作是针对一组数据库图像进行旋转的查询图像执行的。 基于旋转的本地Bag-of-Features操作对该组图像中的每一个进行排名。

公开(公告)号：US08711137B2

公开(公告)日：2014-04-29

申请号：US12354844

申请日：2009-01-16

Applicant: Wen-Chen Fang ,  Chun-Chin Tseng ,  Wen-Zhe Lin ,  Pei-Chi Tsai

Inventor： Wen-Chen Fang ,  Chun-Chin Tseng ,  Wen-Zhe Lin ,  Pei-Chi Tsai

IPC: G09G5/00

CPC classification number: G09G3/3648 ,  G09G3/3696 ,  G09G2310/0245 ,  G09G2320/0257 ,  G09G2330/022 ,  G09G2330/027

Abstract: The present invention discloses a liquid crystal display device and a control method thereof. In the present invention, a clock controller detects an external clock signal and outputs a switching signal according to the external clock signal. According the information carried by the switching signal, a shutoff switching circuit controls a gamma voltage generator and a common voltage circuit to output voltages making a pixel electrode and a common electrode have a zero voltage difference. Thereby, the pixel charges are completely released after system shutoff, and the shutoff retained images are instantly eliminated.

Abstract translation: 本发明公开了一种液晶显示装置及其控制方法。 在本发明中，时钟控制器检测外部时钟信号，并根据外部时钟信号输出开关信号。 根据开关信号所携带的信息，切断开关电路控制伽马电压发生器和公共电压电路以输出使像素电极和公共电极具有零电压差的电压。 因此，在系统关闭之后，像素电荷被完全释放，并且立即消除关闭保持的图像。

公开(公告)号：US08687923B2

公开(公告)日：2014-04-01

申请号：US13565411

申请日：2012-08-02

Applicant: Zhe Lin ,  Scott D. Cohen ,  Jen-Chan Chien ,  Sarah A. Kong ,  Jianchao Yang

Inventor： Zhe Lin ,  Scott D. Cohen ,  Jen-Chan Chien ,  Sarah A. Kong ,  Jianchao Yang

IPC: G06K9/32 ,  G06K9/00

CPC classification number: G06T3/4053

Abstract: Methods and systems for image upscaling are disclosed. In one embodiment, a low frequency band image intermediate is obtained from an input image. The input image is upsampled by a scale factor to obtain an upsampled image intermediate. A result image is estimated based at least in part on the upsampled image intermediate, the low frequency band image intermediate, and the input image, wherein the input image is of a smaller scale than the result image.

Abstract translation: 公开了用于图像放大的方法和系统。 在一个实施例中，从输入图像获得低频带图像中间体。 输入图像由比例因子上采样，以获得上采样图像中间值。 至少部分地基于上采样图像中间，低频带图像中间和输入图像来估计结果图像，其中输入图像比结果图像小一些。

公开(公告)号：US08687913B2

公开(公告)日：2014-04-01

申请号：US13551439

申请日：2012-07-17

Applicant: Zhe Lin

Inventor： Zhe Lin

IPC: G06K9/40

CPC classification number: G06T5/003 ,  G06T2207/20012 ,  G06T2207/20016

Abstract: Various embodiments of methods and apparatus for image deblurring and sharpening using local patch self-similarity are disclosed. In some embodiments, an input blurred image is down-sampled to generate a downsized image. The downsized image is convolved with a blur kernel to obtain a smoothed image. For each of a plurality of patches of the input blurred image, a corresponding patch in the smoothed image is found. High frequency components between each of the plurality of corresponding patches in the smoothed image and corresponding patches of the downsized image are computed. The high frequency components are applied to the plurality of patches of the input blurred images to generate a deblurred version of the input blurred image.

Abstract translation: 公开了使用局部斑块自相似性的图像去模糊和锐化的方法和装置的各种实施例。 在一些实施例中，对输入模糊图像进行下采样以产生小尺寸图像。 缩小的图像与模糊内核卷积以获得平滑的图像。 对于输入的模糊图像的多个斑块中的每一个，找到平滑图像中的相应补丁。 计算平滑化图像中的多个相应补丁中的每一个之间的高频分量以及小尺寸图像的相应补丁。 将高频分量应用于输入模糊图像的多个斑块，以产生输入模糊图像的去模糊版本。