公开(公告)号：US09323792B2

公开(公告)日：2016-04-26

申请号：US14314948

申请日：2014-06-25

Applicant: Google Inc.

Inventor： Ming Zhao ,  Yantao Zheng ,  Yang Song ,  Hartwig Adam

IPC: G06F7/00 ,  G06F17/30 ,  G06F17/00

CPC classification number: G06F17/30289 ,  G06F17/30247 ,  G06F17/30265 ,  G06F17/30312 ,  G06F17/30861

Abstract: This invention relates to building a landmark database from web data. In one embodiment, a computer-implemented method builds a landmark database. Web data including a web page is received from one or more websites via one or more networks. The web data is interpreted using at least one processor to determine landmark data describing a landmark. At least a portion of the landmark data identifies a landmark. Finally, a visual model is generated using the landmark data. A computing device is able to recognize the landmark in an image based on the visual model.

Abstract translation: 本发明涉及从网络数据建立地标数据库。 在一个实施例中，计算机实现的方法构建地标数据库。 通过一个或多个网络从一个或多个网站接收包括网页的网页数据。 使用至少一个处理器来解释网络数据，以确定描述地标的地标数据。 地标数据的至少一部分标识了一个里程碑。 最后，使用地标数据生成视觉模型。 计算设备能够基于视觉模型识别图像中的地标。

公开(公告)号：US09183460B2

公开(公告)日：2015-11-10

申请号：US13690381

申请日：2012-11-30

Applicant: Google Inc.

Inventor： John R. Zhang ,  Charles J. Rosenberg ,  Yang Song

IPC: G06K9/62

CPC classification number: G06K9/6202 ,  G06K9/6212 ,  G06K2009/6213

Abstract: Methods, systems and apparatus for identifying modified images based on visual dissimilarity to a first image. In an aspect, a method includes determining, for each of a first image and a second image, a respective set of local image feature descriptions; determining one or more unmatched regions of the images that include unmatched image features and that correspond to one or more same respective regions in both the first image and the second image; determining, for each of the one or more unmatched regions of the images, a modification measure based on the image data corresponding to the unmatched region in the first image and the image data corresponding to the unmatched region in the second image; and determining that the second image is a modification of the first image when one of the modification measures meets a modification measure threshold.

Abstract translation: 用于基于与第一图像的视觉差异来识别修改图像的方法，系统和装置。 在一方面，一种方法包括为第一图像和第二图像中的每一个确定相应的局部图像特征描述集合; 确定包括不匹配的图像特征并且对应于第一图像和第二图像中的一个或多个相同的相应区域的图像的一个或多个不匹配的区域; 基于与第一图像中的不匹配区域相对应的图像数据和对应于第二图像中的不匹配区域的图像数据，为图像的一个或多个不匹配区域中的每一个确定修改度量; 以及当所述修改措施之一满足修改度量阈值时，确定所述第二图像是所述第一图像的修改。

公开(公告)号：US20150170004A1

公开(公告)日：2015-06-18

申请号：US14449262

申请日：2014-08-01

Applicant: Google Inc.

Inventor： Yang Song ,  Charles J. Rosenberg ,  Andrew Yan-Tak Ng ,  Bo Chen

IPC: G06K9/68 ,  G06K9/62 ,  G06K9/46

CPC classification number: G06K9/68 ,  G06K9/46 ,  G06K9/623 ,  G06K9/6267

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for creating an image similarity model. In one aspect, a method includes obtaining feature vectors for images in a set of images, and determining first similarity measures for unlabeled images relative to a reference image. The first similarity measures are independent of first similarity feedback between the unlabeled images and the reference image. The unlabeled images are ranked based on the first similarity measures, and a weighted feature vector is generated based, in part, on the ranking. Second similarity measures are determined, independent of second similarity feedback, for labeled images and a second reference image. The labeled images are ranked based on the second similarity measures. The weighted feature vector is adjusted based, in part, on a comparison of the ranking to a second ranking of the labeled images that is based on the second similarity feedback.

Abstract translation: 方法，系统和装置，包括在计算机存储介质上编码的计算机程序，用于创建图像相似性模型。 一方面，一种方法包括获得一组图像中的图像的特征向量，以及确定相对于参考图像的未标记图像的第一相似性度量。 第一相似性度量与未标记图像和参考图像之间的第一相似性反馈无关。 基于第一相似性度量对未标记的图像进行排序，并且部分地基于排名生成加权特征向量。 对于标记图像和第二参考图像，确定与第二相似性反馈无关的第二相似性度量。 基于第二相似性度量对标记图像进行排序。 部分地基于基于第二相似性反馈的标记图像的排名与第二排名的比较来调整加权特征向量。

公开(公告)号：US20150169930A1

公开(公告)日：2015-06-18

申请号：US13690404

申请日：2012-11-30

Applicant: Google Inc.

Inventor： Zhongli Ding ,  Gabriel Wolosin ,  John R. Zhang ,  Charles J. Rosenberg ,  Yang Song

IPC: G06K9/00

CPC classification number: G06F17/30256 ,  G06F17/30244

Abstract: Methods, systems and apparatus for identifying modified images based on seed images that are known to be modified images. In an aspect, a method includes accessing data identifying a set of first seed images; for each first seed image, determining a respective first set of similar images from images in an image corpus, each similar image having a visual similarity score that is a measure of visual similarity of the similar image to the first seed image based on the image content of the similar image and the first seed image that satisfies a first seed image similarity threshold; and for each similar image in each respective first set of similar images, attributing to the similar image signal data of each first seed image for which the similar image has a respective visual similarity score satisfying the first seed image similarity threshold.

Abstract translation: 用于基于已知是修改图像的种子图像识别修改图像的方法，系统和装置。 一方面，一种方法包括访问识别一组第一种子图像的数据; 对于每个第一种子图像，从图像语料库中的图像确定相应的第一组相似图像，每个相似图像具有视觉相似度得分，其是基于图像内容的类似图像与第一种子图像的视觉相似度的量度 以及满足第一种子图像相似性阈值的第一种子图像; 并且对于每个相应的第一组相似图像中的每个相似图像，归因于类似图像具有满足第一种子图像相似性阈值的相应视觉相似性得分的每个第一种子图像的相似图像信号数据。

公开(公告)号：US20150169708A1

公开(公告)日：2015-06-18

申请号：US14249523

申请日：2014-04-10

Applicant: Google Inc.

Inventor： Yang Song ,  Thomas J. Duerig

IPC: G06F17/30

CPC classification number: G06F16/54 ,  G06F16/50 ,  G06F16/583 ,  G06F16/951

Abstract: A computer implemented technique for presenting selected image search results is presented. The technique includes obtaining a first query at a first time and obtaining a first set of image search results responsive to the first query. The technique also includes providing the first set of image search results in response to the first query and obtaining input data reflecting a selection of at least one of the first set of image search results. The technique further includes obtaining a second query at a second time subsequent to the first time and obtaining a second set of image search results responsive to the second query. The technique further includes providing the second set of image search results together with the selected at least one of the first set of image search results.

Abstract translation: 提出了一种用于呈现所选图像搜索结果的计算机实现技术。 该技术包括在第一时间获得第一查询并且响应于第一查询获得第一组图像搜索结果。 该技术还包括响应于第一查询提供第一组图像搜索结果并获得反映第一组图像搜索结果中的至少一个的选择的输入数据。 该技术还包括在第一次之后的第二时间获得第二查询，并且响应于第二查询获得第二组图像搜索结果。 该技术还包括提供第二组图像搜索结果以及所选择的第一组图像搜索结果中的至少一个。

公开(公告)号：US09275310B2

公开(公告)日：2016-03-01

申请号：US14449262

申请日：2014-08-01

Applicant: Google Inc.

Inventor： Yang Song ,  Charles J. Rosenberg ,  Andrew Yan-Tak Ng ,  Bo Chen

IPC: G06K9/68 ,  G06K9/62 ,  G06K9/46

CPC classification number: G06K9/68 ,  G06K9/46 ,  G06K9/623 ,  G06K9/6267

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for creating an image similarity model. In one aspect, a method includes obtaining feature vectors for images in a set of images, and determining first similarity measures for unlabeled images relative to a reference image. The first similarity measures are independent of first similarity feedback between the unlabeled images and the reference image. The unlabeled images are ranked based on the first similarity measures, and a weighted feature vector is generated based, in part, on the ranking. Second similarity measures are determined, independent of second similarity feedback, for labeled images and a second reference image. The labeled images are ranked based on the second similarity measures. The weighted feature vector is adjusted based, in part, on a comparison of the ranking to a second ranking of the labeled images that is based on the second similarity feedback.

Abstract translation: 方法，系统和装置，包括在计算机存储介质上编码的计算机程序，用于创建图像相似性模型。 一方面，一种方法包括获得一组图像中的图像的特征向量，以及确定相对于参考图像的未标记图像的第一相似性度量。 第一相似性度量与未标记图像和参考图像之间的第一相似性反馈无关。 基于第一相似性度量对未标记的图像进行排序，并且部分地基于排名生成加权特征向量。 对于标记图像和第二参考图像，确定与第二相似性反馈无关的第二相似性度量。 基于第二相似性度量对标记图像进行排序。 部分地基于基于第二相似性反馈的标记图像的排名与第二排名的比较来调整加权特征向量。

公开(公告)号：US09251171B2

公开(公告)日：2016-02-02

申请号：US13690404

申请日：2012-11-30

Applicant: Google Inc.

Inventor： Zhongli Ding ,  Gabriel Wolosin ,  John R. Zhang ,  Charles J. Rosenberg ,  Yang Song

IPC: G06K9/00 ,  G06F17/30 ,  H04N5/66

CPC classification number: G06F17/30256 ,  G06F17/30244

Abstract: Methods, systems and apparatus for identifying modified images based on seed images that are known to be modified images. In an aspect, a method includes accessing data identifying a set of first seed images; for each first seed image, determining a respective first set of similar images from images in an image corpus, each similar image having a visual similarity score that is a measure of visual similarity of the similar image to the first seed image based on the image content of the similar image and the first seed image that satisfies a first seed image similarity threshold; and for each similar image in each respective first set of similar images, attributing to the similar image signal data of each first seed image for which the similar image has a respective visual similarity score satisfying the first seed image similarity threshold.

Abstract translation: 用于基于已知是修改图像的种子图像识别修改图像的方法，系统和装置。 一方面，一种方法包括访问识别一组第一种子图像的数据; 对于每个第一种子图像，从图像语料库中的图像确定相应的第一组相似图像，每个相似图像具有视觉相似度得分，其是基于图像内容的类似图像与第一种子图像的视觉相似度的量度 以及满足第一种子图像相似性阈值的第一种子图像; 并且对于每个相应的第一组相似图像中的每个相似图像，归因于类似图像具有满足第一种子图像相似性阈值的相应视觉相似性得分的每个第一种子图像的相似图像信号数据。

公开(公告)号：US20140310319A1

公开(公告)日：2014-10-16

申请号：US14314948

申请日：2014-06-25

Applicant: Google Inc.

Inventor： Ming Zhao ,  Yantao Zheng ,  Yang Song ,  Hartwig Adam

IPC: G06F17/30

CPC classification number: G06F17/30289 ,  G06F17/30247 ,  G06F17/30265 ,  G06F17/30312 ,  G06F17/30861

Abstract: This invention relates to building a landmark database from web data. In one embodiment, a computer-implemented method builds a landmark database. Web data including a web page is received from one or more websites via one or more networks. The web data is interpreted using at least one processor to determine landmark data describing a landmark. At least a portion of the landmark data identifies a landmark. Finally, a visual model is generated using the landmark data. A computing device is able to recognize the landmark in an image based on the visual model.

Abstract translation: 本发明涉及从网络数据建立地标数据库。 在一个实施例中，计算机实现的方法构建地标数据库。 通过一个或多个网络从一个或多个网站接收包括网页的网页数据。 使用至少一个处理器来解释网络数据，以确定描述地标的地标数据。 地标数据的至少一部分标识了一个里程碑。 最后，使用地标数据生成视觉模型。 计算设备能够基于视觉模型识别图像中的地标。

公开(公告)号：US20170243082A1

公开(公告)日：2017-08-24

申请号：US15504870

申请日：2015-06-19

Applicant: Google Inc.

Inventor： Yang Song ,  Jiang Wang ,  Charles J. Rosenberg

IPC: G06K9/62 ,  G06F17/30 ,  G06N99/00 ,  G06K9/66

CPC classification number: G06K9/6215 ,  G06F17/30256 ,  G06F17/3028 ,  G06K9/6212 ,  G06K9/627 ,  G06K9/66 ,  G06N3/0454 ,  G06N99/005

Abstract: Methods, systems, and apparatus, for determining fine-grained image similarity. In one aspect, a method includes training an image embedding function on image triplets by selecting image triplets of first, second and third images; generating, by the image embedding function, a first, second and third representations of the features of the first, second and third images; determining, based on the first representation of features and the second representation of features, a first similarity measure for the first image to the second image; determining, based on the first representation of features and the third representation of features, a second similarity measure for the first image to the third image; determining, based on the first and second similarity measures, a performance measure of the image embedding function for the image triplet; and adjusting the parameter weights of the image embedding function based on the performance measures for the image triplets.

公开(公告)号：US09183296B1

公开(公告)日：2015-11-10

申请号：US14461076

申请日：2014-08-15

Applicant: Google Inc.

Inventor： Yang Song ,  Ming Zhao ,  Bingbing Ni

IPC: H04N5/76 ,  G06F17/30

CPC classification number: G06F17/30796 ,  G06F17/30598 ,  H04N5/76 ,  H04N5/91 ,  H04N9/8205 ,  H04N21/23418 ,  H04N21/278

Abstract: Systems and methods are provided herein relating to video classification. A text mining component is disclosed that automatically generates a plurality of video event categories. Part-of-Speech (POS) analysis can be applied to video titles and descriptions, further using a lexical hierarchy to filter potential classifications. Classification performance can be further improved by extracting content-based features from a video sample. Using the content based features a set of classifier scores can be generated. A hyper classifier can use both the classifier scores and the content-based features of the video to classify the video sample.

Abstract translation: 本文提供了与视频分类相关的系统和方法。 公开了一种自动生成多个视频事件类别的文本挖掘组件。 语音（POS）分析可以应用于视频标题和描述，进一步使用词法层次来过滤潜在的分类。 通过从视频样本中提取基于内容的特征，可以进一步提高分类性能。 使用基于内容的功能可以生成一组分类器分数。 超分类器可以使用分类器分数和视频的基于内容的特征来对视频样本进行分类。