公开(公告)号：US08891819B2

公开(公告)日：2014-11-18

申请号：US13192923

申请日：2011-07-28

申请人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

发明人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

IPC分类号： G06K9/46 ,  G06T7/00 ,  G06K9/00 ,  A61B3/113

CPC分类号： A61B3/113 ,  G06K9/00604 ,  G06T7/73 ,  G06T2207/30201

摘要： A line-of-sight detection apparatus includes a detection unit configured to detect a face from image data, a first extraction unit configured to extract a feature amount corresponding to a direction of the face from the image data, a calculation unit configured to calculate a line-of-sight reliability of each of a right eye and a left eye based on the face, a selection unit configured to select an eye according to the line-of-sight reliability, a second extraction unit configured to extract a feature amount of an eye region of the selected eye from the image data, and an estimation unit configured to estimate a line of sight of the face based on the feature amount corresponding to the face direction and the feature amount of the eye region.

摘要翻译： 视线检测装置包括被配置为从图像数据检测面部的检测单元，第一提取单元，被配置为从图像数据中提取与脸部的方向相对应的特征量;计算单元，被配置为计算 基于脸部的右眼和左眼各自的视线可靠性，被配置为根据视线可靠性来选择眼睛的选择单元，被配置为提取特征量的特征量的第二提取单元 根据图像数据的所选择的眼睛的眼睛区域，以及估计单元，被配置为基于与眼睛区域的面部方向和特征量相对应的特征量来估计脸部的视线。

公开(公告)号：US08761459B2

公开(公告)日：2014-06-24

申请号：US13194640

申请日：2011-07-29

申请人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

发明人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

IPC分类号： G06K9/00

CPC分类号： G06K9/00597 ,  G06K9/00221

摘要： The present invention refers to an information processing apparatus comprising: an obtaining unit adapted to obtain an image of an object; a face region detection unit adapted to detect a face region of the object from the image; an eye region detection unit adapted to detect an eye region of the object; a generation unit adapted to generate a high-resolution image and low-resolution image of the face region detected by the face region detection means; a first extraction unit adapted to extract a first feature amount indicating a direction of a face existing in the face region from the low-resolution image; a second extraction unit adapted to extract a second feature amount indicating a direction of an eye existing in the eye region from the high-resolution image; and an estimation unit adapted to estimate a gaze direction of the object from the first feature amount and the second feature amount.

摘要翻译： 本发明涉及一种信息处理装置，包括：获取单元，用于获得对象的图像; 面部区域检测单元，适于从图像检测对象的面部区域; 眼部区域检测单元，其适于检测所述物体的眼睛区域; 生成单元，其适于生成由所述面部区域检测单元检测出的面部区域的高分辨率图像和低分辨率图像; 第一提取单元，适于从低分辨率图像中提取指示存在于面部区域中的脸部的方向的第一特征量; 第二提取单元，适于从高分辨率图像提取指示存在于眼睛区域中的眼睛的方向的第二特征量; 以及估计单元，其适于从所述第一特征量和所述第二特征量估计所述对象的凝视方向。

公开(公告)号：US20120189160A1

公开(公告)日：2012-07-26

申请号：US13192923

申请日：2011-07-28

申请人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

发明人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

IPC分类号： G06K9/46 ,  H04N5/225

CPC分类号： A61B3/113 ,  G06K9/00604 ,  G06T7/73 ,  G06T2207/30201

摘要： A line-of-sight detection apparatus includes a detection unit configured to detect a face from image data, a first extraction unit configured to extract a feature amount corresponding to a direction of the face from the image data, a calculation unit configured to calculate a line-of-sight reliability of each of a right eye and a left eye based on the face, a selection unit configured to select an eye according to the line-of-sight reliability, a second extraction unit configured to extract a feature amount of an eye region of the selected eye from the image data, and an estimation unit configured to estimate a line of sight of the face based on the feature amount corresponding to the face direction and the feature amount of the eye region.

摘要翻译： 视线检测装置包括被配置为从图像数据检测面部的检测单元，第一提取单元，被配置为从图像数据中提取与脸部的方向相对应的特征量;计算单元，被配置为计算 基于脸部的右眼和左眼各自的视线可靠性，被配置为根据视线可靠性来选择眼睛的选择单元，被配置为提取特征量的特征量的第二提取单元 根据图像数据的所选择的眼睛的眼睛区域，以及估计单元，被配置为基于与眼睛区域的面部方向和特征量相对应的特征量来估计脸部的视线。

公开(公告)号：US20120082384A1

公开(公告)日：2012-04-05

申请号：US13326710

申请日：2011-12-15

申请人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

发明人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

IPC分类号： G06K9/46

CPC分类号： G06K9/00281 ,  G06K9/00248 ,  G06K9/00308

摘要： A feature point detection unit (153) and feature amount extraction unit (154) extract a plurality of features of an object from input image data. When there are unextracted features of the plurality of features, a weight setting unit (155) sets weights for the extracted features. A facial expression determination unit (156) executes recognition processing of the object based on the features weighted by the weight setting unit (155).

摘要翻译： 特征点检测单元（153）和特征量提取单元（154）从输入图像数据中提取对象的多个特征。 当存在多个特征的未提取的特征时，权重设置单元（155）设置所提取的特征的权重。 面部表情确定单元（156）基于由权重设定单元（155）加权的特征来执行对象的识别处理。

公开(公告)号：US20100118163A1

公开(公告)日：2010-05-13

申请号：US12691072

申请日：2010-01-21

申请人： Masakazu Matsugu ,  Katsuhiko Mori ,  Yuji Kaneda ,  Tadashi Hayashi

发明人： Masakazu Matsugu ,  Katsuhiko Mori ,  Yuji Kaneda ,  Tadashi Hayashi

IPC分类号： H04N5/76

CPC分类号： G06K9/00248 ,  G03B17/16 ,  G06K9/00315 ,  G06T7/97 ,  H04N5/232 ,  H04N5/23219 ,  H04N5/23222 ,  H04N5/772 ,  H04N2101/00

摘要： In an image capturing apparatus, a video input unit (2) captures the image of an object and sequentially acquires image data associated with the image capturing, a model data memory (6) stores model data associated with the first feature quantity calculated from a feature point of the object in a model image, a principal object detection unit (3) calculates the second feature quantity from a feature point of the object in the acquired image data, a state change estimation unit (4) estimates, on the basis of the second feature quantity and the model data, the timing when the object satisfies a predetermined condition, and an image input processing control unit (7) stores the image data corresponding to the estimated timing in an image recording unit (5). This configuration makes the image capturing apparatus acquire an image in a more proper state without large-capacity memory.

摘要翻译： 在图像捕获装置中，视频输入单元（2）捕获对象的图像并顺序获取与图像拍摄相关联的图像数据，模型数据存储器（6）存储与从特征计算出的第一特征量相关联的模型数据 主体对象检测单元（3）根据所获取的图像数据中的对象的特征点计算第二特征量，状态变化估计单元（4）基于所获取的图像数据 第二特征量和模型数据，对象满足预定条件的定时，图像输入处理控制单元（7）将与估计的定时对应的图像数据存储在图像记录单元（5）中。 该配置使得图像捕获装置在没有大容量存储器的情况下获得更适当状态的图像。

公开(公告)号：US08542928B2

公开(公告)日：2013-09-24

申请号：US11532979

申请日：2006-09-19

申请人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

发明人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

IPC分类号： G06K9/46

CPC分类号： G06K9/00302 ,  G06K9/00281 ,  G06K9/00315 ,  G06K9/4628

摘要： An information processing apparatus includes an image input unit which inputs image data containing a face, a face position detection unit which detects, from the image data, the position of a specific part of the face, and a facial expression recognition unit which detects a feature point of the face from the image data on the basis of the detected position of the specific part and determines facial expression of the face on the basis of the detected feature point. The feature point is detected at a detection accuracy higher than detection of the position of the specific part. Detection of the position of the specific part is robust to a variation in the detection target.

摘要翻译： 一种信息处理设备，包括输入包含脸部的图像数据的图像输入单元，从图像数据检测脸部的特定部分的位置的面部位置检测单元和检测特征部分的面部表情识别单元 根据检测到的特定部位的位置，根据图像数据显示面部的点，并且基于检测到的特征点来确定面部的脸部表情。 以比特定部位的位置的检测更高的检测精度来检测特征点。 对特定部位的位置的检测对于检测目标的变化是鲁棒的。

公开(公告)号：US08515136B2

公开(公告)日：2013-08-20

申请号：US11330138

申请日：2006-01-12

申请人： Katsuhiko Mori ,  Yuji Kaneda ,  Masakazu Matsugu ,  Yusuke Mitarai ,  Takashi Suzuki

发明人： Katsuhiko Mori ,  Yuji Kaneda ,  Masakazu Matsugu ,  Yusuke Mitarai ,  Takashi Suzuki

IPC分类号： G06K9/00

CPC分类号： G06K9/00281 ,  G06K9/00221 ,  G06K9/00302 ,  G06K9/00315 ,  G06K9/00664 ,  G06T7/73 ,  G06T2207/10016 ,  G06T2207/20084 ,  G06T2207/30201

摘要： An image including a face is input (S201), a plurality of local features are detected from the input image, a region of a face in the image is specified using the plurality of detected local features (S202), and an expression of the face is determined on the basis of differences between the detection results of the local features in the region of the face and detection results which are calculated in advance as references for respective local features in the region of the face (S204).

摘要翻译： 输入包括脸部的图像（S201），从输入图像检测多个局部特征，使用多个检测到的局部特征来指定图像中的脸部的区域（S202），并且脸部的表达 基于面部区域中的局部特征的检测结果与预先计算的检测结果之间的差异确定，作为面部区域中的各个局部特征的参考（S204）。

公开(公告)号：US08285002B2

公开(公告)日：2012-10-09

申请号：US11572884

申请日：2005-07-27

申请人： Katsuhiko Mori ,  Masakazu Matsugu ,  Yusuke Mitarai ,  Yuji Kaneda

发明人： Katsuhiko Mori ,  Masakazu Matsugu ,  Yusuke Mitarai ,  Yuji Kaneda

IPC分类号： G06K9/00

CPC分类号： G06K9/0061 ,  G06T5/005 ,  G06T7/0002 ,  G06T11/00 ,  G06T2207/10024 ,  G06T2207/30216 ,  H04N1/628

摘要： An eye region is detected, in the detected eye region, the region of an iris outline is extended inward, and a hollow region surrounded by the extended region is detected as a poor hue quality region. An outline of the poor hue quality region is shaped by approximating the outline to one of a circle and an ellipse. The hue of the shaped poor hue quality region is corrected on the basis of color information obtained from a neighboring region inside an iris outline.

摘要翻译： 在检测到的眼睛区域中，检测到眼睛区域，虹膜轮廓的区域向内延伸，并且被扩展区域包围的中空区域被检测为不良的色调质量区域。 通过将轮廓近似为圆和椭圆之一来形成差的色调质量区域的轮廓。 基于从虹膜轮廓内的相邻区域获得的颜色信息来校正成形不良色调质量区域的色调。

公开(公告)号：US20120033853A1

公开(公告)日：2012-02-09

申请号：US13194640

申请日：2011-07-29

申请人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

发明人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

IPC分类号： G06K9/46

CPC分类号： G06K9/00597 ,  G06K9/00221

摘要： The present invention refers to an information processing apparatus comprising: an obtaining unit adapted to obtain an image of an object; a face region detection unit adapted to detect a face region of the object from the image; an eye region detection unit adapted to detect an eye region of the object; a generation unit adapted to generate a high-resolution image and low-resolution image of the face region detected by the face region detection means; a first extraction unit adapted to extract a first feature amount indicating a direction of a face existing in the face region from the low-resolution image; a second extraction unit adapted to extract a second feature amount indicating a direction of an eye existing in the eye region from the high-resolution image; and an estimation unit adapted to estimate a gaze direction of the object from the first feature amount and the second feature amount.

摘要翻译： 本发明涉及一种信息处理装置，包括：获取单元，用于获得对象的图像; 面部区域检测单元，适于从图像检测对象的面部区域; 眼部区域检测单元，其适于检测所述物体的眼睛区域; 生成单元，其适于生成由所述面部区域检测单元检测出的面部区域的高分辨率图像和低分辨率图像; 第一提取单元，适于从低分辨率图像中提取指示存在于面部区域中的脸部的方向的第一特征量; 第二提取单元，适于从高分辨率图像提取指示存在于眼睛区域中的眼睛的方向的第二特征量; 以及估计单元，其适于从所述第一特征量和所述第二特征量估计所述对象的凝视方向。

公开(公告)号：US20080181508A1

公开(公告)日：2008-07-31

申请号：US12021659

申请日：2008-01-29

申请人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

发明人： Yuji Kaneda ,  Masakazu Matsugu ,  Katsuhiko Mori

IPC分类号： G06K9/46

CPC分类号： G06K9/00281 ,  G06K9/00248 ,  G06K9/00308

摘要： A feature point detection unit (153) and feature amount extraction unit (154) extract a plurality of features of an object from input image data. When there are unextracted features of the plurality of features, a weight setting unit (155) sets weights for the extracted features. A facial expression determination unit (156) executes recognition processing of the object based on the features weighted by the weight setting unit (155).

摘要翻译： 特征点检测单元（153）和特征量提取单元（154）从输入图像数据中提取对象的多个特征。 当存在多个特征的未提取的特征时，权重设置单元（155）设置所提取的特征的权重。 面部表情确定单元（156）基于由权重设定单元（155）加权的特征来执行对象的识别处理。