公开(公告)号：US09554093B2

公开(公告)日：2017-01-24

申请号：US11626251

申请日：2007-01-23

申请人： Xian-Sheng Hua ,  Wei Lai ,  Wei-Ying Ma ,  Shipeng Li

发明人： Xian-Sheng Hua ,  Wei Lai ,  Wei-Ying Ma ,  Shipeng Li

IPC分类号： H04N7/10 ,  H04N7/173 ,  H04N21/234 ,  H04N21/2387 ,  H04N21/472 ,  H04N21/6587 ,  H04N21/81

CPC分类号： H04N21/812 ,  H04N7/17318 ,  H04N21/23424 ,  H04N21/2387 ,  H04N21/47202 ,  H04N21/6587 ,  H04N21/8133

摘要： Systems and methods for automatically inserting advertisements into source video content playback streams are described. In one aspect, the systems and methods communicate a source video content playback stream to a video player to present source video to a user. During playback of the source video, and in response to receipt of a request from the user to navigate portions of the source video (e.g., a user command to fast forward the source video, rewind the source video, or other action), the systems and methods dynamically define a video advertisement clip insertion point (e.g., and insertion point based on a current playback position). The systems and methods then insert a contextually relevant and/or targeted video advertisement clip into the playback stream for presentation to the user.

摘要翻译： 描述了将广告自动插入到源视频内容回放流中的系统和方法。 在一个方面，系统和方法将源视频内容播放流传送给视频播放器，以向用户呈现源视频。 在播放源视频期间，并且响应于接收到来自用户的请求以导航源视频的部分（例如，用户命令来快速转发源视频，倒带源视频或其他动作），系统 并且方法动态地定义视频广告剪辑插入点（例如，基于当前播放位置的插入点）。 然后，系统和方法将上下文相关和/或目标视频广告剪辑插入到播放流中以呈现给用户。

公开(公告)号：US20140321761A1

公开(公告)日：2014-10-30

申请号：US14324375

申请日：2014-07-07

申请人： Jingdong Wang ,  Xian-Sheng Hua

发明人： Jingdong Wang ,  Xian-Sheng Hua

IPC分类号： G06F17/30 ,  G06K9/62

摘要： Techniques for intelligent image search results summarization and browsing scheme are described. Images having visual attributes are evaluated for similarities based in part on their visual attributes. At least one preference score indicating a probability of an image to be selected into a summary is calculated for each image. Images are selected based on the similarity of the selected images to the other images and the preference scores of the selected images. A summary of the plurality of images is generated including the selected one individual image.

摘要翻译： 描述了智能图像搜索结果汇总和浏览方案的技术。 根据其视觉属性，对具有视觉属性的图像进行相似度的评估。 针对每个图像计算指示将图像选择为概要的概率的至少一个偏好分数。 基于所选择的图像与其他图像的相似度以及所选图像的偏好分数来选择图像。 生成包括所选择的一个单独图像的多个图像的概要。

公开(公告)号：US08831352B2

公开(公告)日：2014-09-09

申请号：US13079592

申请日：2011-04-04

申请人： Mingyan Gao ,  Xian-Sheng Hua

发明人： Mingyan Gao ,  Xian-Sheng Hua

IPC分类号： G06K9/46 ,  G06K9/00 ,  G06F17/30

CPC分类号： G06F17/30265 ,  G06K9/00671

摘要： Events may be determined based on an image and context data associated with the image. An event type associated with the image may be determined based on a concept of the image. A list of events may be retrieved from an event database based on the context data. The retrieved list of events may then be ranked based on the determined event type and the context data. Through this event determination, a user may obtain information of one or more events happening at a specific location simply by capturing an image of that specific location, thereby saving the user from searching and browsing the Internet or brochure to locate the information of the one or more events at the specific location.

摘要翻译： 可以基于与图像相关联的图像和上下文数据来确定事件。 可以基于图像的概念来确定与图像相关联的事件类型。 可以基于上下文数据从事件数据库检索事件列表。 然后可以基于所确定的事件类型和上下文数据对所检索的事件列表进行排名。 通过该事件确定，用户可以通过捕获特定位置的图像来获取在特定位置发生的一个或多个事件的信息，从而保存用户不需要搜索和浏览因特网或小册子，以定位该信息的一个或多个 更多的事件在特定的位置。

公开(公告)号：US20140250110A1

公开(公告)日：2014-09-04

申请号：US13394425

申请日：2011-11-25

申请人： Linjun Yang ,  Bo Geng ,  Xian-Sheng Hua ,  Shipeng Li

发明人： Linjun Yang ,  Bo Geng ,  Xian-Sheng Hua ,  Shipeng Li

IPC分类号： G06F17/30

CPC分类号： G06F16/5866 ,  G06F16/2228 ,  G06F16/248 ,  G06F16/583 ,  G06F16/9535

摘要： Attractiveness of an image may be estimated by integrating extracted visual features with contextual cues pertaining to the image. Image attractiveness may be defined by the visual features (e.g., perceptual quality, aesthetic sensitivity, and/or affective tone) of elements contained within the image. Images may be indexed based on the estimated attractiveness, search results may be presented based on image attractiveness, and/or a user may elect, after receiving image search results, to re-rank the image search results by attractiveness.

摘要翻译： 图像的吸引力可以通过将提取的视觉特征与与图像有关的语境线索相结合来估计。 图像吸引力可以由包含在图像内的元素的视觉特征（例如感知质量，美学敏感度和/或情感色调）来定义。 可以基于估计的吸引力来索引图像，可以基于图像吸引力来呈现搜索结果，和/或用户可以在接收图像搜索结果之后选择通过吸引力重新排列图像搜索结果。

公开(公告)号：US08825744B2

公开(公告)日：2014-09-02

申请号：US12813328

申请日：2010-06-10

申请人： Meng Wang ,  Xian-Sheng Hua ,  Kuiyuan Yang

发明人： Meng Wang ,  Xian-Sheng Hua ,  Kuiyuan Yang

IPC分类号： G06F15/16

CPC分类号： G06F17/30268

摘要： Methods and systems for active image tagging are usable to build large datasets of tagged images by combining manual tagging by a user and automatic tagging by a computing device based on the manual tagging. Such tags may be used to effectively sort, organize, link, and search for images within large datasets of images. Additionally, the active image tagging may be configured to utilize a tagging game where multiple users manually tag images by playing a game on a computing device.

摘要翻译： 用于主动图像标记的方法和系统可用于通过组合用户的手动标记和基于手动标记的计算设备的自动标记来构建标记图像的大数据集。 这样的标签可以用于有效地对图像的大数据集内的图像进行排序，组织，链接和搜索。 此外，活动图像标签可以被配置为利用标签游戏，其中多个用户通过在计算设备上玩游戏来手动地标记图像。

公开(公告)号：US08804005B2

公开(公告)日：2014-08-12

申请号：US12111202

申请日：2008-04-29

申请人： Tao Mei ,  Xian-Sheng Hua ,  Shipeng Li ,  Zhiwei Gu

发明人： Tao Mei ,  Xian-Sheng Hua ,  Shipeng Li ,  Zhiwei Gu

IPC分类号： G06K9/62 ,  G06K9/34

CPC分类号： G11B27/28 ,  G06K9/00711 ,  G06K9/6282

摘要： Visual concepts contained within a video clip are classified based upon a set of target concepts. The clip is segmented into shots and a multi-layer multi-instance (MLMI) structured metadata representation of each shot is constructed. A set of pre-generated trained models of the target concepts is validated using a set of training shots. An MLMI kernel is recursively generated which models the MLMI structured metadata representation of each shot by comparing prescribed pairs of shots. The MLMI kernel is subsequently utilized to generate a learned objective decision function which learns a classifier for determining if a particular shot (that is not in the set of training shots) contains instances of the target concepts. A regularization framework can also be utilized in conjunction with the MLMI kernel to generate modified learned objective decision functions. The regularization framework introduces explicit constraints which serve to maximize the precision of the classifier.

摘要翻译： 视频剪辑中包含的视觉概念基于一组目标概念进行分类。 剪辑被分割成镜头，并且构建每个镜头的多层多实例（MLMI）结构化元数据表示。 使用一组训练镜头验证了一组预先生成的目标概念训练模型。 通过比较规定的拍摄对，递归地生成MLMI内核，以对每个镜头的MLMI结构化元数据表示进行建模。 MLMI内核随后被用于生成学习的客观决策函数，该函数学习用于确定特定镜头（不在该组训练镜头中）是否包含目标概念的实例的分类器。 正则化框架也可以与MLMI内核一起使用，以生成修改后的学习目标决策函数。 正则化框架引入明确的约束，用于最大化分类器的精度。

公开(公告)号：US08542324B2

公开(公告)日：2013-09-24

申请号：US12790176

申请日：2010-05-28

申请人： Meng Wang ,  Linjun Yang ,  Xian-Sheng Hua ,  Bo Liu

发明人： Meng Wang ,  Linjun Yang ,  Xian-Sheng Hua ,  Bo Liu

IPC分类号： H04N9/12

CPC分类号： A61B3/066 ,  H04N1/465 ,  H04N1/58 ,  H04N1/6075

摘要： Colors of images and videos are modified to make differences in the colors more perceptible to colorblind users. An exemplary recoloring process utilizes a color space transformation, a local color rotation and a global color rotation to transform colors of visual objects from colors which may not be distinguishable by the colorblind user to colors which may be distinguishable by the colorblind user.

摘要翻译： 修改了图像和视频的颜色，以使颜色变得更加明显，使得用户无法察觉。 示例性的再染色过程利用颜色空间变换，局部颜色旋转和全局颜色旋转来将可视对象的颜色从颜色变化的颜色变换为可能被色盲用户区分开来的颜色，这些颜色可以由着色用户区分。

公开(公告)号：US08504422B2

公开(公告)日：2013-08-06

申请号：US12786020

申请日：2010-05-24

申请人： Tao Mei ,  Xian-Sheng Hua ,  Shipeng Li ,  Jinlian Guo ,  Fei Sheng

发明人： Tao Mei ,  Xian-Sheng Hua ,  Shipeng Li ,  Jinlian Guo ,  Fei Sheng

IPC分类号： G06Q30/00

CPC分类号： G06F17/30056 ,  G06F17/30047 ,  G06Q30/02 ,  G06Q30/0243

摘要： Techniques for recommending music and advertising to enhance a user's experience while photo browsing are described. In some instances, songs and ads are ranked for relevance to at least one photo from a photo album. The songs, ads and photo(s) from the photo album are then mapped to a style and mood ontology to obtain vector-based representations. The vector-based representations can include real valued terms, each term associated with a human condition defined by the ontology. A re-ranking process generates a relevancy term for each song and each ad indicating relevancy to the photo album. The relevancy terms can be calculated by summing weighted terms from the ranking and the mapping. Recommended music and ads may then be provided to a user, as the user browses a series of photos obtained from the photo album. The ads may be seamlessly embedded into the music in a nonintrusive manner.

摘要翻译： 描述用于推荐音乐和广告以提高用户在照相浏览时体验的技术。 在某些情况下，歌曲和广告的排名与相册中的至少一张照片相关。 然后将相册中的歌曲，广告和照片映射到风格和心境本体以获得基于矢量的表示。 基于向量的表示可以包括实际值，每个术语与由本体定义的人类条件相关联。 重新排序过程产生每个歌曲的相关术语，每个广告指示相册的相关性。 可以通过从排名和映射求和加权项来计算相关项。 然后，当用户浏览从相册获得的一系列照片时，推荐的音乐和广告可以被提供给用户。 广告可以无缝地嵌入到音乐中。

公开(公告)号：US08412694B2

公开(公告)日：2013-04-02

申请号：US12355795

申请日：2009-01-18

申请人： Meng Wang ,  Linjun Yang ,  Xian-Sheng Hua

发明人： Meng Wang ,  Linjun Yang ,  Xian-Sheng Hua

IPC分类号： G06F7/00 ,  G06F17/30

CPC分类号： G06F17/3025

摘要： Colorblind accessible image search technique embodiments are presented that re-rank the results of a relevance-ranked image search to account for the accessibility of the images to a colorblind person. This is accomplished by first computing a colorblind accessibility quantity for each image of interest in the search results. A colorblind accessibility quantity quantizes the degree to which color information is preserved when an image is perceived by a colorblind person viewing the image. It is computed by generating a colorblind version of an image that simulates how the image would appear to the colorblind person. An amount quantifying the loss of color information between the image and the colorblind version of the image is then estimated. This estimate is used to compute the colorblind accessibility quantity for the image. Once the colorblind accessibility quantities have been computed, the image search results are re-ranked based on these quantities.

摘要翻译： 呈现了彩色盲可访问图像搜索技术实施例，其对排序相关的图像搜索的结果进行重新排序，以便将图像的可访问性应用于彩色盲人。 这是通过首先计算搜索结果中感兴趣的每个图像的色盲辅助数量来实现的。 彩色可见量可以量化当查看图像的彩色盲人感知到图像时保留颜色信息的程度。 它通过生成图像的彩色版本来计算，该图像模拟图像将如何显示给彩色盲人。 然后估计量化图像和图像的彩色版本之间的颜色信息的损失的量。 该估计用于计算图像的色盲辅助数量。 一旦计算了色盲辅助数量，就会根据这些数量重新排列图像搜索结果。

公开(公告)号：US08392430B2

公开(公告)日：2013-03-05

申请号：US12565313

申请日：2009-09-23

申请人： Xian-Sheng Hua ,  Jingdong Wang ,  Hao Xu

发明人： Xian-Sheng Hua ,  Jingdong Wang ,  Hao Xu

IPC分类号： G06F17/30

CPC分类号： G06F17/3053 ,  G06F17/30265

摘要： The concept-structured image search technique described herein pertains to a technique for enabling a user to indicate their semantic intention and then retrieve and rank images from a database or other image set according to this intention. The concept-structured image search technique described herein includes a new interface for image search. With this interface, a user can freely type several key textual words in arbitrary positions on a blank image, and also describe a region for each keyword that indicates its influence scope, which is called concept structure herein. The concept-structured image search technique will return and rank images that are in accordance with the concept structure indicated by the user. One embodiment of the technique can be used to create a synthesized image without actually using the synthesized image to perform a search of an image set.

摘要翻译： 本文描述的概念结构图像搜索技术涉及一种使用户能够指示其语义意图，然后根据该意图从数据库或其他图像集中检索和排列图像的技术。 本文所述的概念结构图像搜索技术包括用于图像搜索的新界面。 通过该接口，用户可以在空白图像上任意位置自由地键入几个关键文本字，并且还描述指示其影响范围的每个关键字的区域，这在本文中被称为概念结构。 概念结构图像搜索技术将返回并对与用户指示的概念结构相一致的图像进行排序。 该技术的一个实施例可以用于创建合成图像而不实际使用合成图像来执行图像集的搜索。