公开(公告)号：US20070067345A1

公开(公告)日：2007-03-22

申请号：US11233352

申请日：2005-09-21

申请人： Ming Li ,  Wei-Ying Ma ,  Xing Xie ,  Xin Fan ,  Zhiwei Li

发明人： Ming Li ,  Wei-Ying Ma ,  Xing Xie ,  Xin Fan ,  Zhiwei Li

IPC分类号： G06F7/00

CPC分类号： G06F17/30864 ,  Y10S707/99945 ,  Y10S707/99948

摘要： A method and system for generating a search request from a multimodal query that includes a query image and query text is provided. The multimodal query system identifies images of a collection that are textually related to the query image based on similarity between words associated with each image and the query text. The multimodal query system then selects those images of the identified images that are visually related to the query image. The multimodal query system may formulate a search request based on keywords of web pages that contain the selected images and submit that search request to a search engine service.

摘要翻译： 提供了一种用于从包含查询图像和查询文本的多模式查询生成搜索请求的方法和系统。 多模式查询系统基于与每个图像相关联的单词与查询文本之间的相似度来识别与查询图像文本相关的集合的图像。 多模式查询系统然后选择与查询图像视觉相关的识别图像的那些图像。 多模式查询系统可以基于包含所选图像的网页的关键词来制定搜索请求，并将该搜索请求提交给搜索引擎服务。

公开(公告)号：US20120093371A1

公开(公告)日：2012-04-19

申请号：US13332248

申请日：2011-12-20

申请人： Ming Jing Li ,  Wei-Ying Ma ,  Xing Xie ,  Xin Fan ,  Zhiwei Li

发明人： Ming Jing Li ,  Wei-Ying Ma ,  Xing Xie ,  Xin Fan ,  Zhiwei Li

IPC分类号： G06K9/00 ,  G06K9/54

CPC分类号： G06F16/951 ,  Y10S707/99945 ,  Y10S707/99948

摘要： A method and system for generating a search request from a multimodal query that includes a query image and query text is provided. The multimodal query system identifies images of a collection that are textually related to the query image based on similarity between words associated with each image and the query text. The multimodal query system then selects those images of the identified images that are visually related to the query image. The multimodal query system may formulate a search request based on keywords of web pages that contain the selected images and submit that search request to a search engine service.

摘要翻译： 提供了一种用于从包含查询图像和查询文本的多模式查询生成搜索请求的方法和系统。 多模式查询系统基于与每个图像相关联的单词与查询文本之间的相似度来识别与查询图像文本相关的集合的图像。 多模式查询系统然后选择与查询图像视觉相关的识别图像的那些图像。 多模式查询系统可以基于包含所选图像的网页的关键词来制定搜索请求，并将该搜索请求提交给搜索引擎服务。

公开(公告)号：US20090041366A1

公开(公告)日：2009-02-12

申请号：US12247958

申请日：2008-10-08

申请人： Ming Jing Li ,  Wei-Ying Ma ,  Xing Xie ,  Xin Fan ,  Zhiwei Li

发明人： Ming Jing Li ,  Wei-Ying Ma ,  Xing Xie ,  Xin Fan ,  Zhiwei Li

IPC分类号： G06K9/36

CPC分类号： G06F17/30864 ,  Y10S707/99945 ,  Y10S707/99948

摘要： A method and system for generating a search request from a multimodal query that includes a query image and query text is provided. The multimodal query system identifies images of a collection that are textually related to the query image based on similarity between words associated with each image and the query text. The multimodal query system then selects those images of the identified images that are visually related to the query image. The multimodal query system may formulate a search request based on keywords of web pages that contain the selected images and submit that search request to a search engine service.

摘要翻译： 提供了一种用于从包含查询图像和查询文本的多模式查询生成搜索请求的方法和系统。 多模式查询系统基于与每个图像相关联的单词与查询文本之间的相似度来识别与查询图像文本相关的集合的图像。 多模式查询系统然后选择与查询图像视觉相关的识别图像的那些图像。 多模式查询系统可以基于包含所选图像的网页的关键词来制定搜索请求，并将该搜索请求提交给搜索引擎服务。

公开(公告)号：US08081824B2

公开(公告)日：2011-12-20

申请号：US12247958

申请日：2008-10-08

申请人： Ming Jing Li ,  Wei-Ying Ma ,  Xing Xie ,  Xin Fan ,  Zhiwei Li

发明人： Ming Jing Li ,  Wei-Ying Ma ,  Xing Xie ,  Xin Fan ,  Zhiwei Li

IPC分类号： G06K9/46

CPC分类号： G06F17/30864 ,  Y10S707/99945 ,  Y10S707/99948

摘要： A method and system for generating a search request from a multimodal query that includes a query image and query text is provided. The multimodal query system identifies images of a collection that are textually related to the query image based on similarity between words associated with each image and the query text. The multimodal query system then selects those images of the identified images that are visually related to the query image. The multimodal query system may formulate a search request based on keywords of web pages that contain the selected images and submit that search request to a search engine service.

摘要翻译： 提供了一种用于从包含查询图像和查询文本的多模式查询生成搜索请求的方法和系统。 多模式查询系统基于与每个图像相关联的单词与查询文本之间的相似度来识别与查询图像文本相关的集合的图像。 多模式查询系统然后选择与查询图像视觉相关的识别图像的那些图像。 多模式查询系统可以基于包含所选图像的网页的关键词来制定搜索请求，并将该搜索请求提交给搜索引擎服务。

公开(公告)号：US07457825B2

公开(公告)日：2008-11-25

申请号：US11233352

申请日：2005-09-21

申请人： Ming Jing Li ,  Wei-Ying Ma ,  Xing Xie ,  Xin Fan ,  Zhiwei Li

发明人： Ming Jing Li ,  Wei-Ying Ma ,  Xing Xie ,  Xin Fan ,  Zhiwei Li

IPC分类号： G06F7/00

CPC分类号： G06F17/30864 ,  Y10S707/99945 ,  Y10S707/99948

摘要： A method and system for generating a search request from a multimodal query that includes a query image and query text is provided. The multimodal query system identifies images of a collection that are textually related to the query image based on similarity between words associated with each image and the query text. The multimodal query system then selects those images of the identified images that are visually related to the query image. The multimodal query system may formulate a search request based on keywords of web pages that contain the selected images and submit that search request to a search engine service.

摘要翻译： 提供了一种用于从包含查询图像和查询文本的多模式查询生成搜索请求的方法和系统。 多模式查询系统基于与每个图像相关联的单词与查询文本之间的相似度来识别与查询图像文本相关的集合的图像。 多模式查询系统然后选择与查询图像视觉相关的识别图像的那些图像。 多模式查询系统可以基于包含所选图像的网页的关键词来制定搜索请求，并将该搜索请求提交给搜索引擎服务。

公开(公告)号：US20060155684A1

公开(公告)日：2006-07-13

申请号：US11034443

申请日：2005-01-12

申请人： Hao Liu ,  Wei-Ying Ma ,  Xing Xie ,  Zhiwei Li

发明人： Hao Liu ,  Wei-Ying Ma ,  Xing Xie ,  Zhiwei Li

IPC分类号： G06F7/00 ,  G06F17/00

CPC分类号： G06F17/30274 ,  G06F17/30873 ,  Y10S707/99945 ,  Y10S707/99948

摘要： Systems and methods to present web image search results for effective image browsing are described. In one aspect, task-based attention objects for each of multiple images associated with image search results are generated. Thumbnail images from respective ones of the images are created as a function of at least the task-based attention objects. The thumbnail images emphasize image region(s) of greater priority to a user in view of a keyword or expanded keyword associated with the search results.

公开(公告)号：US07548936B2

公开(公告)日：2009-06-16

申请号：US11034443

申请日：2005-01-12

申请人： Hao Liu ,  Wei-Ying Ma ,  Xing Xie ,  Zhiwei Li

发明人： Hao Liu ,  Wei-Ying Ma ,  Xing Xie ,  Zhiwei Li

IPC分类号： G06F7/00

CPC分类号： G06F17/30274 ,  G06F17/30873 ,  Y10S707/99945 ,  Y10S707/99948

摘要： Systems and methods to present web image search results for effective image browsing are described. In one aspect, task-based attention objects for each of multiple images associated with image search results are generated. Thumbnail images from respective ones of the images are created as a function of at least the task-based attention objects. The thumbnail images emphasize image region(s) of greater priority to a user in view of a keyword or expanded keyword associated with the search results.

摘要翻译： 描述用于呈现用于有效图像浏览的web图像搜索结果的系统和方法。 在一个方面，生成与图像搜索结果相关联的多个图像中的每一个的基于任务的注意对象。 作为至少基于任务的注意对象的功能创建来自相应图像的缩略图像。 鉴于与搜索结果相关联的关键字或扩展关键字，缩略图图像强调对用户具有更高优先级的图像区域。

公开(公告)号：US20070286484A1

公开(公告)日：2007-12-13

申请号：US11841080

申请日：2007-08-20

申请人： Xing Xie ,  Wei-Ying Ma ,  Hong-Jiang Zhang ,  Liqun Chen ,  Xin Fan

发明人： Xing Xie ,  Wei-Ying Ma ,  Hong-Jiang Zhang ,  Liqun Chen ,  Xin Fan

IPC分类号： G06K9/34

CPC分类号： G06K9/3233 ,  G06K9/4671 ,  G06T7/00 ,  G06T11/60 ,  G06T2200/16

摘要： Systems and methods for adapting images for substantially optimal presentation by heterogeneous client display sizes are described. In one aspect, an image is modeled with respect to multiple visual attentions to generate respective attention objects for each of the visual attentions. For each of one or more image adaptation schemes, an objective measure of information fidelity (IF) is determined for a region R of the image. The objective measures are determined as a function of a resource constraint of the display device and as a function of a weighted sum of IF of each attention object in the region R. A substantially optimal adaptation scheme is then selected as a function of the calculated objective measures. The image is then adapted via the selected substantially optimal adaptation scheme to generate an adapted image as a function of at least the target area of the client display.

摘要翻译： 描述了用于通过异构客户端显示大小适配图像以实现基本最佳呈现的系统和方法。 在一个方面，针对多个视觉注意来建模图像，以产生每个视觉注意的各自的注意对象。 对于一个或多个图像适配方案中的每一个，针对图像的区域R确定信息保真度（IF）的客观测量。 根据显示设备的资源约束来确定客观度量，并且根据区域R中每个关注对象的IF的加权和的函数来确定目标度量。然后根据计算出的目标选择基本上最佳的适应方案 措施。 然后，经由所选择的基本上最佳的自适应方案来适配图像以根据至少客户端显示的目标区域生成适配图像。

公开(公告)号：US07260261B2

公开(公告)日：2007-08-21

申请号：US10371125

申请日：2003-02-20

申请人： Xing Xie ,  Wei-Ying Ma ,  Hong-Jiang Zhang ,  Liqun Chen ,  Xin Fan

发明人： Xing Xie ,  Wei-Ying Ma ,  Hong-Jiang Zhang ,  Liqun Chen ,  Xin Fan

IPC分类号： G06K9/34

CPC分类号： G06K9/3233 ,  G06K9/4671 ,  G06T7/00 ,  G06T11/60 ,  G06T2200/16

摘要： Systems and methods for adapting images for substantially optimal presentation by heterogeneous client display sizes are described. In one aspect, an image is modeled with respect to multiple visual attentions to generate respective attention objects for each of the visual attentions. For each of one or more image adaptation schemes, an objective measure of information fidelity (IF) is determined for a region R of the image. The objective measures are determined as a function of a resource constraint of the display device and as a function of a weighted sum of IF of each attention object in the region R. A substantially optimal adaptation scheme is then selected as a function of the calculated objective measures. The image is then adapted via the selected substantially optimal adaptation scheme to generate an adapted image as a function of at least the target area of the client display.

摘要翻译： 描述了用于通过异构客户端显示大小适配图像以实现基本最佳呈现的系统和方法。 在一个方面，针对多个视觉注意来建模图像，以产生每个视觉注意的各自的注意对象。 对于一个或多个图像适配方案中的每一个，针对图像的区域R确定信息保真度（IF）的客观测量。 根据显示设备的资源约束来确定客观度量，并且根据区域R中每个注意对象的IF的加权和的函数确定目标度量。然后根据计算出的目标选择基本上最佳的适应方案 措施。 然后，经由所选择的基本上最佳的自适应方案来适配图像以根据至少客户端显示的目标区域生成适配图像。

公开(公告)号：US07860317B2

公开(公告)日：2010-12-28

申请号：US11278575

申请日：2006-04-04

申请人： Xing Xie ,  Wei-Ying Ma ,  Xin Fan ,  Yinghua Zhou

发明人： Xing Xie ,  Wei-Ying Ma ,  Xin Fan ,  Yinghua Zhou

IPC分类号： G06K9/46 ,  G06K9/00

CPC分类号： G06F17/30259 ,  G06K9/6211

摘要： A method and system for searching for content relating to a target or query image by identifying duplicate images with associated content is provided. An image search system identifies visual parts of objects within the target image based on analysis of two or more versions of the target image. The image search system identifies visual parts based on analysis of the versions. The image search system then identifies images of an image database that have visual parts that are similar to the visual parts of the target image. The image search system may rank the identified images based on their likelihood of being duplicates of the target image and provide their associated content as the search result ordered according to the ranking of the images.

摘要翻译： 提供了一种用于通过识别具有相关内容的重复图像来搜索与目标或查询图像相关的内容的方法和系统。 图像搜索系统基于目标图像的两个或多个版本的分析来识别目标图像内的对象的可视部分。 图像搜索系统基于对版本的分析来识别视觉部分。 图像搜索系统然后识别具有与目标图像的视觉部分相似的视觉部分的图像数据库的图像。 图像搜索系统可以基于它们是目标图像的重复的可能性来对所识别的图像进行排序，并且根据图像的排序来提供其相关联的内容作为搜索结果排序。