公开(公告)号：US08452778B1

公开(公告)日：2013-05-28

申请号：US12874015

申请日：2010-09-01

申请人： Yang Song ,  Ming Zhao ,  Jay Yagnik

发明人： Yang Song ,  Ming Zhao ,  Jay Yagnik

IPC分类号： G06F17/30 ,  G10L19/12

CPC分类号： G06F17/30799 ,  G06F17/30796 ,  G06K9/00711

摘要： A classifier training system trains adapted classifiers for classifying videos based at least in part on scores produced by application of text-based classifiers to textual metadata of the videos. Each classifier corresponds to a particular category, and when applied to a given video indicates whether the video represents the corresponding category. The classifier training system applies the text-based classifiers to textual metadata of the videos to obtain the scores, and also extracts features from content of the videos, combining the scores and the content features for a video into a set of hybrid features. The adapted classifiers are then trained on the hybrid features. The adaption of the text-based classifiers from the textual domain to the video domain allows the training of accurate video classifiers (the adapted classifiers) without requiring a large training set of authoritatively labeled videos.

摘要翻译： 分类器训练系统训练适用的分类器，用于至少部分地基于将基于文本的分类器应用于视频的文本元数据而产生的分数来分类视频。 每个分类器对应于特定类别，并且当应用于给定视频时指示视频是否表示相应类别。 分类器训练系统将基于文本的分类器应用于视频的文本元数据以获得分数，并且还从视频内容中提取特征，将视频的分数和内容特征组合成一组混合特征。 然后对适应的分类器对混合特征进行训练。 基于文本的分类器从文本域到视频域的适应允许训练准确的视频分类器（适应的分类器），而不需要大量的授权标签视频的训练集。

公开(公告)号：US08792732B1

公开(公告)日：2014-07-29

申请号：US13559420

申请日：2012-07-26

申请人： Ming Zhao ,  Jay Yagnik

发明人： Ming Zhao ,  Jay Yagnik

IPC分类号： G06K9/46 ,  H04N5/14

CPC分类号： G06K9/6232 ,  G06K9/6215

摘要： An object recognition system performs a number of rounds of dimensionality reduction and consistency learning on visual content items such as videos and still images, resulting in a set of feature vectors that accurately predict the presence of a visual object represented by a given object name within an visual content item. The feature vectors are stored in association with the object name which they represent and with an indication of the number of rounds of dimensionality reduction and consistency learning that produced them. The feature vectors and the indication can be used for various purposes, such as quickly determining a visual content item containing a visual representation of a given object name.

摘要翻译： 对象识别系统对诸如视频和静止图像的视觉内容项目执行多次维数降低和一致性学习，导致一组特征向量，其精确地预测由一个对象名称表示的视觉对象的存在 视觉内容项目。 特征向量与它们所代表的对象名称相关联地存储，并且显示产生它们的维度降低和一致性学习的轮次数。 特征向量和指示可以用于各种目的，诸如快速确定包含给定对象名称的视觉表示的视觉内容项。

公开(公告)号：US08301498B1

公开(公告)日：2012-10-30

申请号：US13488126

申请日：2012-06-04

申请人： Corinna Cortes ,  Sanjiv Kumar ,  Ameesh Makadia ,  Gideon Mann ,  Jay Yagnik ,  Ming Zhao

发明人： Corinna Cortes ,  Sanjiv Kumar ,  Ameesh Makadia ,  Gideon Mann ,  Jay Yagnik ,  Ming Zhao

IPC分类号： G06Q30/00 ,  G06N5/02

CPC分类号： H04N21/2407 ,  G06F17/30784 ,  G06F17/30817 ,  G06F17/3082 ,  G06F17/30828 ,  G06K9/00711 ,  H04N21/23418 ,  H04N21/25883 ,  H04N21/4668 ,  H04N21/4826

摘要： A video demographics analysis system selects a training set of videos to use to correlate viewer demographics and video content data. The video demographics analysis system extracts demographic data from viewer profiles related to videos in the training set and creates a set of demographic distributions, and also extracts video data from videos in the training set. The video demographics analysis system correlates the viewer demographics with the video data of videos viewed by that viewer. Using the prediction model produced by the machine learning process, a new video about which there is no a priori knowledge can be associated with a predicted demographic distribution specifying probabilities of the video appealing to different types of people within a given demographic category, such as people of different ages within an age demographic category.

摘要翻译： 视频人口统计分析系统选择用于将观众人口特征和视频内容数据相关联的一组视频。 视频人口统计分析系统从与训练集中的视频相关的观众简档中提取人口统计学数据，并创建一组人口分布，并从训练集中的视频中提取视频数据。 视频人口统计分析系统将观众人口统计学与观众观看的视频的视频数据相关联。 使用机器学习过程产生的预测模型，可以将预测的人口分布与预测的人口分布相关联，所述预测人口统计分布规定了给定人口统计学类别中的不同类型的人的视频的概率，例如人 在不同年龄的人口统计学类别。

公开(公告)号：US08213689B2

公开(公告)日：2012-07-03

申请号：US12172939

申请日：2008-07-14

申请人： Jay Yagnik ,  Ming Zhao

发明人： Jay Yagnik ,  Ming Zhao

IPC分类号： G06K9/00 ,  G06K9/62

CPC分类号： G06K9/00711 ,  G06F17/30781 ,  G06K9/00295 ,  G06K9/6255

摘要： Methods and systems for automated annotation of persons in video content are disclosed. In one embodiment, a method of identifying faces in a video includes the stages of: generating face tracks from input video streams; selecting key face images for each face track; clustering the face tracks to generate face clusters; creating face models from the face clusters; and correlating face models with a face model database. In another embodiment, a system for identifying faces in a video includes a face model database having face entries with face models and corresponding names, and a video face identifier module. In yet another embodiment, the system for identifying faces in a video can also have a face model generator.

摘要翻译： 公开了用于视频内容中的人的自动注释的方法和系统。 在一个实施例中，识别视频中的面部的方法包括以下阶段：从输入视频流生成面部曲面; 为每个脸部轨迹选择关键脸部图像; 聚集脸部轨迹以生成脸部群集; 从脸部群集中创建面部模型; 并将面部模型与面部模型数据库相关联。 在另一个实施例中，用于识别视频中的面部的系统包括具有面部表情和面部模型和对应名称的面部模型数据库，以及视频面部识别器模块。 在另一个实施例中，用于识别视频中的面部的系统还可以具有面部模型生成器。

公开(公告)号：US20100191689A1

公开(公告)日：2010-07-29

申请号：US12392987

申请日：2009-02-25

申请人： Corinna Cortes ,  Sanjiv Kumar ,  Ameesh Makadia ,  Gideon Mann ,  Jay Yagnik ,  Ming Zhao

发明人： Corinna Cortes ,  Sanjiv Kumar ,  Ameesh Makadia ,  Gideon Mann ,  Jay Yagnik ,  Ming Zhao

IPC分类号： G06N5/02 ,  H04N7/10

CPC分类号： H04N21/2407 ,  G06F16/735 ,  G06F16/78 ,  G06F16/783 ,  G06F16/7867 ,  G06K9/00711 ,  H04N21/23418 ,  H04N21/25883 ,  H04N21/4668 ,  H04N21/4826

摘要： A video demographics analysis system selects a training set of videos to use to correlate viewer demographics and video content data. The video demographics analysis system extracts demographic data from viewer profiles related to videos in the training set and creates a set of demographic distributions, and also extracts video data from videos in the training set. The video demographics analysis system correlates the viewer demographics with the video data of videos viewed by that viewer. Using the prediction model produced by the machine learning process, a new video about which there is no a priori knowledge can be associated with a predicted demographic distribution specifying probabilities of the video appealing to different types of people within a given demographic category, such as people of different ages within an age demographic category.

摘要翻译： 视频人口统计分析系统选择用于将观众人口特征和视频内容数据相关联的一组视频。 视频人口统计分析系统从与训练集中的视频相关的观众简档中提取人口统计学数据，并创建一组人口分布，并从训练集中的视频中提取视频数据。 视频人口统计分析系统将观众人口统计学与观众观看的视频的视频数据相关联。 使用机器学习过程产生的预测模型，可以将预测的人口分布与预测的人口分布相关联，所述预测人口统计分布规定了给定人口统计学类别中的不同类型的人的视频的概率，例如人 在不同年龄的人口统计学类别。

公开(公告)号：US20120272259A1

公开(公告)日：2012-10-25

申请号：US13488126

申请日：2012-06-04

申请人： Corinna Cortes ,  Sanjiv Kumar ,  Ameesh Makadia ,  Gideon Mann ,  Jay Yagnik ,  Ming Zhao

发明人： Corinna Cortes ,  Sanjiv Kumar ,  Ameesh Makadia ,  Gideon Mann ,  Jay Yagnik ,  Ming Zhao

IPC分类号： H04N21/24

CPC分类号： H04N21/2407 ,  G06F17/30784 ,  G06F17/30817 ,  G06F17/3082 ,  G06F17/30828 ,  G06K9/00711 ,  H04N21/23418 ,  H04N21/25883 ,  H04N21/4668 ,  H04N21/4826

摘要： A video demographics analysis system selects a training set of videos to use to correlate viewer demographics and video content data. The video demographics analysis system extracts demographic data from viewer profiles related to videos in the training set and creates a set of demographic distributions, and also extracts video data from videos in the training set. The video demographics analysis system correlates the viewer demographics with the video data of videos viewed by that viewer. Using the prediction model produced by the machine learning process, a new video about which there is no a priori knowledge can be associated with a predicted demographic distribution specifying probabilities of the video appealing to different types of people within a given demographic category, such as people of different ages within an age demographic category.

摘要翻译： 视频人口统计分析系统选择用于将观众人口特征和视频内容数据相关联的一组视频。 视频人口统计分析系统从与训练集中的视频相关的观众简档中提取人口统计学数据，并创建一组人口分布，并从训练集中的视频中提取视频数据。 视频人口统计分析系统将观众人口统计学与观众观看的视频的视频数据相关联。 使用机器学习过程产生的预测模型，可以将预测的人口分布与预测的人口分布相关联，所述预测人口统计分布规定了给定人口统计学类别中的不同类型的人的视频的概率，例如人 在不同年龄的人口统计学类别。

公开(公告)号：US08254699B1

公开(公告)日：2012-08-28

申请号：US12364390

申请日：2009-02-02

申请人： Ming Zhao ,  Jay Yagnik

发明人： Ming Zhao ,  Jay Yagnik

IPC分类号： G06K9/46 ,  G06K9/48 ,  H04N5/14 ,  G06E1/00

CPC分类号： G06K9/6232 ,  G06K9/6215

摘要： An object recognition system performs a number of rounds of dimensionality reduction and consistency learning on visual content items such as videos and still images, resulting in a set of feature vectors that accurately predict the presence of a visual object represented by a given object name within an visual content item. The feature vectors are stored in association with the object name which they represent and with an indication of the number of rounds of dimensionality reduction and consistency learning that produced them. The feature vectors and the indication can be used for various purposes, such as quickly determining a visual content item containing a visual representation of a given object name.

摘要翻译： 对象识别系统对诸如视频和静止图像的视觉内容项目执行多次维数降低和一致性学习，导致一组特征向量，其精确地预测由一个对象名称表示的视觉对象的存在 视觉内容项目。 特征向量与它们所代表的对象名称相关联地存储，并且显示产生它们的维度降低和一致性学习的轮次数。 特征向量和指示可以用于各种目的，诸如快速确定包含给定对象名称的视觉表示的视觉内容项。

公开(公告)号：US20100008547A1

公开(公告)日：2010-01-14

申请号：US12172939

申请日：2008-07-14

申请人： Jay YAGNIK ,  Ming Zhao

发明人： Jay YAGNIK ,  Ming Zhao

IPC分类号： G06K9/00

CPC分类号： G06K9/00711 ,  G06F17/30781 ,  G06K9/00295 ,  G06K9/6255

摘要： Methods and systems for automated annotation of persons in video content are disclosed. In one embodiment, a method of identifying faces in a video includes the stages of: generating face tracks from input video streams; selecting key face images for each face track; clustering the face tracks to generate face clusters; creating face models from the face clusters; and correlating face models with a face model database. In another embodiment, a system for identifying faces in a video includes a face model database having face entries with face models and corresponding names, and a video face identifier module. In yet another embodiment, the system for identifying faces in a video can also have a face model generator.

摘要翻译： 公开了用于视频内容中的人的自动注释的方法和系统。 在一个实施例中，识别视频中的面部的方法包括以下阶段：从输入视频流生成面部曲面; 为每个脸部轨迹选择关键脸部图像; 聚集脸部轨迹以生成脸部群集; 从脸部群集中创建面部模型; 并将面部模型与面部模型数据库相关联。 在另一个实施例中，用于识别视频中的面部的系统包括具有面部表情和面部模型和对应名称的面部模型数据库，以及视频面部识别器模块。 在另一个实施例中，用于识别视频中的面部的系统还可以具有面部模型生成器。

公开(公告)号：US10108620B2

公开(公告)日：2018-10-23

申请号：US13098362

申请日：2011-04-29

申请人： Ming Zhao ,  Yang Song ,  Hartwig Adam ,  Ullas Gargi ,  Yushi Jing ,  Henry A. Rowley

发明人： Ming Zhao ,  Yang Song ,  Hartwig Adam ,  Ullas Gargi ,  Yushi Jing ,  Henry A. Rowley

IPC分类号： G06K9/46 ,  G06F17/30 ,  G06F17/10 ,  G06K9/62 ,  G06K9/00

摘要： Methods, systems, and apparatus, including computer programs encoded on computer storage media, for associating still images and videos. One method includes receiving a plurality of images and a plurality of videos and determining whether the images are related to the videos. The determining includes, for an image and a video, extracting features from the image and extracting features frames of the video, and comparing the features to determine whether the image is related to the video. The method further includes maintaining a data store storing data associating each image with each video determined to be related to the image.

公开(公告)号：US09652462B2

公开(公告)日：2017-05-16

申请号：US13098368

申请日：2011-04-29

申请人： Ming Zhao ,  Yang Song ,  Hartwig Adam ,  Ullas Gargi ,  Yushi Jing ,  Henry A. Rowley

发明人： Ming Zhao ,  Yang Song ,  Hartwig Adam ,  Ullas Gargi ,  Yushi Jing ,  Henry A. Rowley

IPC分类号： G06K9/72 ,  G06F17/30 ,  G06F17/10 ,  G06K9/62 ,  G06K9/00

CPC分类号： G06F17/3005 ,  G06F17/10 ,  G06F17/3002 ,  G06F17/30029 ,  G06F17/3079 ,  G06F17/30864 ,  G06F19/00 ,  G06K9/00751 ,  G06K9/629

摘要： Methods, systems, and apparatus, including computer programs encoded on computer storage media, for associating still images and videos. One method includes receiving a plurality of images and a plurality of videos and determining whether the images are related to the videos. The determining includes, for an image and a video, extracting features from the image and extracting features frames of the video, and comparing the features to determine whether the image is related to the video. The method further includes maintaining a data store storing data associating each image with each video determined to be related to the image.