公开(公告)号：US08873845B2

公开(公告)日：2014-10-28

申请号：US13569333

申请日：2012-08-08

申请人： Jingdong Wang ,  Zhong Wu ,  Xian-Sheng Hua ,  Shipeng Li ,  Peng Wang

发明人： Jingdong Wang ,  Zhong Wu ,  Xian-Sheng Hua ,  Shipeng Li ,  Peng Wang

IPC分类号： G06K9/00 ,  G06K9/34

CPC分类号： G06F17/3025

摘要： Dominant color names may be extracted from an image by analyzing spatial-context of pixels contained in the image. A dominant color region may be defined by taking a double-threshold approach that addresses ambiguous color regions and a degree of confidence that each pixel belongs in the dominant color region. Affiliation maps and binary maps may be used to generate the dominant color region. Images may be converted to a saliency map, from which a region of interest may be assigned a dominant color name. Image search results may be filtered by the dominant color name associated with the image.

摘要翻译： 可以通过分析包含在图像中的像素的空间上下文从图像中提取主色颜色名称。 主色区域可以通过采用双阈值方法来定义，所述双阈值方法解决不确定的颜色区域和每个像素属于主色区域的置信度。 可以使用隶属关系图和二进制图来生成主色区域。 图像可以转换为显着图，可以从其中将感兴趣区域分配为主要颜色名称。 图像搜索结果可能会被与图像相关联的主要颜色名称过滤。

公开(公告)号：US09092673B2

公开(公告)日：2015-07-28

申请号：US12436783

申请日：2009-05-07

申请人： Jingdong Wang ,  Xian-Sheng Hua ,  Shipeng Li ,  Hao Xu

发明人： Jingdong Wang ,  Xian-Sheng Hua ,  Shipeng Li ,  Hao Xu

IPC分类号： G06K9/62 ,  G06K9/00 ,  G06F17/30

CPC分类号： G06K9/00664 ,  G06F17/30265 ,  G06F17/30719 ,  G06K9/6255

摘要： Described is a technology for computing visual and textual summaries for tagged image collections. Heterogeneous affinity propagation is used to together identify both visual and textual exemplars. The heterogeneous affinity propagation finds the exemplars for relational heterogeneous data (e.g., images and words) by considering the relationships (e.g., similarities) within pairs of images, pairs of words, and relationships of words to images (affinity) in an integrated manner.

摘要翻译： 描述了一种用于计算标记图像集合的视觉和文本摘要的技术。 非均匀亲和度传播用于一起识别视觉和文本样本。 通过考虑图像成对，单词之间的关系（例如，相似度）和单词与图像的关系（亲和性）以集成的方式，异构亲和度传播找到关系异构数据（例如，图像和单词）的示例。

公开(公告)号：US08645380B2

公开(公告)日：2014-02-04

申请号：US12940880

申请日：2010-11-05

申请人： Jingdong Wang ,  Xian-Sheng Hua ,  Shipeng Li ,  You Jia

发明人： Jingdong Wang ,  Xian-Sheng Hua ,  Shipeng Li ,  You Jia

IPC分类号： G06F17/30

CPC分类号： G06F17/3028 ,  G06F17/30333

摘要： Techniques for constructing an optimized kd-tree are described. In an implementation, an optimized kd-tree process receives input of a set of data points applicable for large-scale computer vision applications. The process divides the set of the data points into subsets of data points with nodes while generating hyperplanes (e.g., coordinate axes). The process identifies a partition axis for each node based on the coordinate axes combined in a binary way. The optimized kd-tree process creates an optimized kd-tree that organizes the data points based on the identified partition axis. The organization of the data points in the optimized kd-tree provides efficient indexing and searching for a nearest neighbor.

摘要翻译： 描述了构建优化的kd-tree的技术。 在一个实现中，优化的kd-tree过程接收适用于大规模计算机视觉应用的一组数据点的输入。 该过程在产生超平面（例如，坐标轴）的同时将数据点的集合划分成具有节点的数据点的子集。 该过程基于以二进制方式组合的坐标轴来识别每个节点的分区轴。 优化的kd-tree过程创建一个优化的kd-tree，它根据识别的分区轴组织数据点。 优化的kd-tree中数据点的组织为最近邻居提供了有效的索引和搜索。

公开(公告)号：US08406573B2

公开(公告)日：2013-03-26

申请号：US12341953

申请日：2008-12-22

申请人： Jingdong Wang ,  Shipeng Li ,  Xian-Sheng Hua ,  Yinghai Zhao

发明人： Jingdong Wang ,  Shipeng Li ,  Xian-Sheng Hua ,  Yinghai Zhao

IPC分类号： G06K9/60

CPC分类号： G06K9/00624 ,  G06F17/3025

摘要： This disclosure describes various exemplary user interfaces, methods, and computer program products for the interactively ranking image search results refinement method using a color layout. The method includes receiving a text query for an image search, presenting image search results in a structured presentation based on the text query and information from an interest color layout. The process creates image search results that may be selected by the user based on color selection palettes or color layout specification schemes. Then the process ranks the image search results by sorting the results according to similarity scores between color layouts from the image search results and the interest color layout from a user based on the color selection palettes and the color layout specification schemes.

摘要翻译： 本公开描述了使用颜色布局的用于交互式排序的图像搜索结果细化方法的各种示例性用户界面，方法和计算机程序产品。 该方法包括接收用于图像搜索的文本查询，基于文本查询和来自兴趣颜色布局的信息在结构化表示中呈现图像搜索结果。 该过程创建可以由用户基于颜色选择调色板或颜色布局规范方案来选择的图像搜索结果。 然后，该过程通过根据来自图像搜索结果的颜色布局与基于颜色选择调色板和颜色布局规范方案的用户的兴趣颜色布局之间的相似性分数来排序结果来排序图像搜索结果。

公开(公告)号：US08370363B2

公开(公告)日：2013-02-05

申请号：US13091323

申请日：2011-04-21

申请人： Jingdong Wang ,  Xian-Sheng Hua ,  Shipeng Li ,  Jing Wang

发明人： Jingdong Wang ,  Xian-Sheng Hua ,  Shipeng Li ,  Jing Wang

IPC分类号： G06F17/30

CPC分类号： G06F17/30979

摘要： A hybrid search method may be used to identify information responsive to a query. A search may be performed utilizing a neighborhood graph and a partitioning tree. The partitioning tree may be searched to select one or more pivots that may be used to guide a subsequent search in the neighborhood graph. Once the search in the neighborhood graph is unable to identify nearest neighbors in closer proximity to the query, the search may be switched to the partitioning tree. The partitioning tree may then be searched to select pivots that may be used to guide subsequent searches in the neighborhood graph. The searches performed in the partitioning tree and/or the neighborhood graph may be conducted utilizing an iterative algorithm.

摘要翻译： 可以使用混合搜索方法来识别响应于查询的信息。 可以使用邻域图和分区树来执行搜索。 可以搜索分区树以选择可用于指导邻域图中的后续搜索的一个或多个枢轴。 一旦邻域图中的搜索无法识别更靠近查询的最近邻居，则可以将搜索切换到分区树。 然后可以搜索分区树以选择可用于指导邻域图中的后续搜索的枢轴。 可以使用迭代算法来执行在分区树和/或邻域图中执行的搜索。

公开(公告)号：US20120271833A1

公开(公告)日：2012-10-25

申请号：US13091323

申请日：2011-04-21

申请人： Jingdong Wang ,  Xian-Sheng Hua ,  Shipeng Li ,  Jing Wang

发明人： Jingdong Wang ,  Xian-Sheng Hua ,  Shipeng Li ,  Jing Wang

IPC分类号： G06F17/30

CPC分类号： G06F17/30979

摘要： A hybrid search method may be used to identify information responsive to a query. A search may be performed utilizing a neighborhood graph and a partitioning tree. The partitioning tree may be searched to select one or more pivots that may be used to guide a subsequent search in the neighborhood graph. Once the search in the neighborhood graph is unable to identify nearest neighbors in closer proximity to the query, the search may be switched to the partitioning tree. The partitioning tree may then be searched to select pivots that may be used to guide subsequent searches in the neighborhood graph. The searches performed in the partitioning tree and/or the neighborhood graph may be conducted utilizing an iterative algorithm.

摘要翻译： 可以使用混合搜索方法来识别响应于查询的信息。 可以使用邻域图和分区树来执行搜索。 可以搜索分区树以选择可用于指导邻域图中的后续搜索的一个或多个枢轴。 一旦邻域图中的搜索无法识别更靠近查询的最近邻居，则可以将搜索切换到分区树。 然后可以搜索分区树以选择可用于指导邻域图中的后续搜索的枢轴。 可以使用迭代算法来执行在分区树和/或邻域图中执行的搜索。

公开(公告)号：US20100158412A1

公开(公告)日：2010-06-24

申请号：US12341953

申请日：2008-12-22

申请人： Jingdong Wang ,  Shipeng Li ,  Xian Sheng Hua ,  Yinghai Zhao

发明人： Jingdong Wang ,  Shipeng Li ,  Xian Sheng Hua ,  Yinghai Zhao

IPC分类号： G06K9/54 ,  G06F17/30

CPC分类号： G06K9/00624 ,  G06F17/3025

摘要： This disclosure describes various exemplary user interfaces, methods, and computer program products for the interactively ranking image search results refinement method using a color layout. The method includes receiving a text query for an image search, presenting image search results in a structured presentation based on the text query and information from an interest color layout. The process creates image search results that may be selected by the user based on color selection palettes or color layout specification schemes. Then the process ranks the image search results by sorting the results according to similarity scores between color layouts from the image search results and the interest color layout from a user based on the color selection palettes and the color layout specification schemes.

摘要翻译： 本公开描述了使用颜色布局的用于交互式排序的图像搜索结果细化方法的各种示例性用户界面，方法和计算机程序产品。 该方法包括接收用于图像搜索的文本查询，基于文本查询和来自兴趣颜色布局的信息在结构化表示中呈现图像搜索结果。 该过程创建可以由用户基于颜色选择调色板或颜色布局规范方案来选择的图像搜索结果。 然后，该过程通过根据来自图像搜索结果的颜色布局与基于颜色选择调色板和颜色布局规范方案的用户的兴趣颜色布局之间的相似性分数来排序结果来排序图像搜索结果。

公开(公告)号：US08369656B2

公开(公告)日：2013-02-05

申请号：US12341953

申请日：2008-12-22

申请人： Jingdong Wang ,  Shipeng Li ,  Xian-Sheng Hua ,  Yinghai Zhao

发明人： Jingdong Wang ,  Shipeng Li ,  Xian-Sheng Hua ,  Yinghai Zhao

IPC分类号： G06K9/60

摘要： This disclosure describes various exemplary user interfaces, methods, and computer program products for the interactively ranking image search results refinement method using a color layout. The method includes receiving a text query for an image search, presenting image search results in a structured presentation based on the text query and information from an interest color layout. The process creates image search results that may be selected by the user based on color selection palettes or color layout specification schemes. Then the process ranks the image search results by sorting the results according to similarity scores between color layouts from the image search results and the interest color layout from a user based on the color selection palettes and the color layout specification schemes.

公开(公告)号：US08218859B2

公开(公告)日：2012-07-10

申请号：US12329293

申请日：2008-12-05

申请人： Jingdong Wang ,  Shipeng Li ,  Xian-Sheng Hua ,  Yinghai Zhao

发明人： Jingdong Wang ,  Shipeng Li ,  Xian-Sheng Hua ,  Yinghai Zhao

IPC分类号： G06K9/62 ,  G06K9/00

CPC分类号： G06K9/00718 ,  G06K9/6297

摘要： This disclosure describes various exemplary method and computer program products for transductive multi-label classification in detecting video concepts for information retrieval. This disclosure describes utilizing a hidden Markov random field formulation to detect labels for concepts in a video content and modeling a multi-label interdependence between the labels by a pairwise Markov random field. The process groups the labels into several parts to speed up a labeling inference and calculates a conditional probability score for the labels, the conditional probability scores are ordered for ranking in a video retrieval evaluation.

摘要翻译： 本公开描述了用于检测用于信息检索的视频概念的用于转换多标签分类的各种示例性方法和计算机程序产品。 本公开描述了利用隐马尔科夫随机场公式来检测视频内容中的概念的标签，并通过成对的马尔可夫随机场对标签之间的多标签相互依赖进行建模。 该过程将标签分组成几个部分，以加快标签推理，并计算标签的条件概率分数，条件概率分数被排序用于视频检索评估中的排名。

公开(公告)号：US20110191336A1

公开(公告)日：2011-08-04

申请号：US12696591

申请日：2010-01-29

申请人： Jingdong Wang ,  Xian-Sheng Hua ,  Shipeng Li ,  Hao Xu

发明人： Jingdong Wang ,  Xian-Sheng Hua ,  Shipeng Li ,  Hao Xu

IPC分类号： G06F17/30

CPC分类号： G06F16/00

摘要： Techniques for image search using contextual information related to a user query are described. A user query including at least one of textual data or image data from a collection of data displayed by a computing device is received from a user. At least one other subset of data selected from the collection of data is received as contextual information that is related to and different from the user query. Data files such as image files are retrieved and ranked based on the user query to provide a pre-ranked set of data files. The pre-ranked data files are then ranked based on the contextual information to provide a re-ranked set of data files to be displayed to the user.

摘要翻译： 描述使用与用户查询相关的上下文信息进行图像搜索的技术。 从用户接收包括来自计算设备显示的数据集合的文本数据或图像数据中的至少一个的用户查询。 作为与用户查询相关并且不同于用户查询的上下文信息，接收到从数据收集中选出的至少一个其他数据子集。 基于用户查询来检索和排序诸如图像文件的数据文件，以提供预先排列的数据文件集合。 然后基于上下文信息对预先排序的数据文件进行排名，以提供要向用户显示的重新排列的数据文件集合。