公开(公告)号：US07885477B2

公开(公告)日：2011-02-08

申请号：US11709708

申请日：2007-02-23

申请人： Wataru Ito ,  Hideki Yamagishi ,  Yuanzhong Li

发明人： Wataru Ito ,  Hideki Yamagishi ,  Yuanzhong Li

IPC分类号： G06K9/40

CPC分类号： G06K9/00275 ,  G06K9/621 ,  G06K2009/00932

摘要： A face portion of an input image, an example of a predetermined structure, is applied to a mathematical model by the image recovery/addition section to recover a missing element of the face portion in the input image. The mathematical model is generated by a predetermined statistical method, such as the AAM scheme or the like, based on a plurality of sample images representing the face portion including the recovery target element. Thereafter, the face portion is reconstructed to include the missing element based on the parameter corresponding to the face portion obtained by applying the face portion to the model, and the face portion of the input image is replaced by the reconstructed face portion to produce a restored image by the image reconstruction section.

摘要翻译： 通过图像恢复/添加部分将输入图像的面部部分（预定结构的示例）应用于数学模型，以恢复输入图像中的面部部分的遗漏元素。 基于表示包括恢复目标元素的面部部分的多个样本图像，通过诸如AAM方案等的预定统计方法生成数学模型。 此后，基于通过将面部应用于模型而获得的面部部分的参数，重建面部部分以包括缺失元素，并且输入图像的面部部分被重建的面部部分替换以产生恢复的 图像由图像重建部分。

公开(公告)号：US20070201750A1

公开(公告)日：2007-08-30

申请号：US11709708

申请日：2007-02-23

申请人： Wataru Ito ,  Hideki Yamagishi ,  Yuanzhong Li

发明人： Wataru Ito ,  Hideki Yamagishi ,  Yuanzhong Li

IPC分类号： G06K9/62

CPC分类号： G06K9/00275 ,  G06K9/621 ,  G06K2009/00932

摘要： A face portion of an input image, an example of a predetermined structure, is applied to a mathematical model by the image recovery/addition section to recover a missing element of the face portion in the input image. The mathematical model is generated by a predetermined statistical method, such as the AAM scheme or the like, based on a plurality of sample images representing the face portion including the recovery target element. Thereafter, the face portion is reconstructed to include the missing element based on the parameter corresponding to the face portion obtained by applying the face portion to the model, and the face portion of the input image is replaced by the reconstructed face portion to produce a restored image by the image reconstruction section.

摘要翻译： 通过图像恢复/添加部分将输入图像的面部部分（预定结构的示例）应用于数学模型，以恢复输入图像中的面部部分的遗漏元素。 基于表示包括恢复目标元素的面部部分的多个样本图像，通过诸如AAM方案等的预定统计方法生成数学模型。 此后，基于通过将面部应用于模型而获得的面部部分的参数，重建面部部分以包括缺失元素，并且输入图像的面部部分被重建的面部部分替换以产生恢复的 图像由图像重建部分。

公开(公告)号：US07756343B2

公开(公告)日：2010-07-13

申请号：US11525839

申请日：2006-09-25

申请人： Yuanzhong Li ,  Wataru Ito

发明人： Yuanzhong Li ,  Wataru Ito

IPC分类号： G06K9/00 ,  G06K9/40 ,  A61B18/18

CPC分类号： G06K9/00248 ,  G06K9/621 ,  G06K9/624 ,  G06T5/005 ,  G06T2207/30201

摘要： An unnecessary component such as acne is removed completely from a predetermined structure such as a face in a photograph image without manual operation and skills. An acne removal unit fits to a face region as the structure in the image a mathematical model generated according to a statistical method such as AAM using sample images representing the structure without the component to be removed, and an image reconstruction unit reconstructs an image of the face region based on parameters corresponding to the face region obtained by the fitting of the model. An image is then generated by replacing the face region with the reconstructed image. Since the mathematical model has been generated from the sample images of human faces without acne, the model does not include acne. Therefore, the reconstructed face image generated by fitting the model to the face region does not include acne.

摘要翻译： 诸如痤疮的不必要的部件被完全从诸如照片图像中的脸部的预定结构中去除而没有手动操作和技能。 痤疮去除单元适合作为图像中的结构的面部区域，根据诸如AAM的统计方法生成的数学模型，使用表示没有要去除的组分的结构的样本图像，并且图像重建单元重建图像的图像 基于通过拟合模型获得的与面部区域相对应的参数的面部区域。 然后通过用重建图像替换面部区域来生成图像。 由于数学模型是从没有痤疮的人脸样本图像生成的，因此该模型不包括痤疮。 因此，通过将模型拟合到面部区域而产生的重建面部图像不包括痤疮。

公开(公告)号：US20070071347A1

公开(公告)日：2007-03-29

申请号：US11525839

申请日：2006-09-25

申请人： Yuanzhong Li ,  Wataru Ito

发明人： Yuanzhong Li ,  Wataru Ito

IPC分类号： G06K9/40

CPC分类号： G06K9/00248 ,  G06K9/621 ,  G06K9/624 ,  G06T5/005 ,  G06T2207/30201

摘要： An unnecessary component such as acne is removed completely from a predetermined structure such as a face in a photograph image without manual operation and skills. An acne removal unit fits to a face region as the structure in the image a mathematical model generated according to a statistical method such as AAM using sample images representing the structure without the component to be removed, and an image reconstruction unit reconstructs an image of the face region based on parameters corresponding to the face region obtained by the fitting of the model. An image is then generated by replacing the face region with the reconstructed image. Since the mathematical model has been generated from the sample images of human faces without acne, the model does not include acne. Therefore, the reconstructed face image generated by fitting the model to the face region does not include acne.

摘要翻译： 诸如痤疮的不必要的部件被完全从诸如照片图像中的脸部的预定结构中去除而没有手动操作和技能。 痤疮去除单元适合作为图像中的结构的面部区域，根据诸如AAM的统计方法生成的数学模型，使用代表没有要去除的组分的结构的样本图像，并且图像重建单元重建图像的图像 基于通过拟合模型获得的与面部区域相对应的参数的面部区域。 然后通过用重建图像替换面部区域来生成图像。 由于数学模型是从没有痤疮的人脸样本图像生成的，因此该模型不包括痤疮。 因此，通过将模型拟合到面部区域而产生的重建面部图像不包括痤疮。

公开(公告)号：US20070071346A1

公开(公告)日：2007-03-29

申请号：US11525073

申请日：2006-09-22

申请人： Yuanzhong Li ,  Wataru Ito

发明人： Yuanzhong Li ,  Wataru Ito

IPC分类号： G06K9/40

CPC分类号： G06T5/003 ,  G06K9/00228 ,  G06K9/621 ,  G06T7/13 ,  G06T2207/20201 ,  G06T2207/30201

摘要： Without use of special hardware such as an angular rate sensor, a direction of blur can be judged with high accuracy. A parameter acquisition unit obtains weighting parameters for principal components representing directions of blur in a predetermined structure in an image by fitting to the structure a mathematical model generated by a method of AAM using a plurality of sample images representing the structure in different conditions of blur. A blur direction judgment unit judges the direction of blur based on the weighting parameters, and a blur width acquisition unit finds a width of blur based on an edge component found by an edge detection unit in the direction perpendicular to the direction of blur. A blur correction unit corrects the blur in the image based on the direction and the width of blur.

摘要翻译： 不使用诸如角速率传感器的特殊硬件，可以高精度地判断模糊的方向。 参数获取单元通过使用表示在不同模糊条件下的结构的多个样本图像通过AAM的方法生成的数学模型来拟合表示图像中的预定结构中的模糊方向的主要部分的加权参数。 模糊方向判断单元基于加权参数来判断模糊的方向，并且模糊宽度获取单元基于边缘检测单元在与模糊方向垂直的方向上找到的边缘分量来找到模糊的宽度。 模糊校正单元根据模糊的方向和宽度校正图像中的模糊。

公开(公告)号：US08577099B2

公开(公告)日：2013-11-05

申请号：US13534817

申请日：2012-06-27

申请人： Yuanzhong Li ,  Sadato Akahori ,  Kensuke Terakawa ,  Yoshiro Kitamura ,  Wataru Ito

发明人： Yuanzhong Li ,  Sadato Akahori ,  Kensuke Terakawa ,  Yoshiro Kitamura ,  Wataru Ito

IPC分类号： G06K9/00 ,  G06K9/46

CPC分类号： G06K9/00281

摘要： First, a face within an image, which is a target of detection, is detected. Detection data of the face is employed to detect eyes which are included in the face. Detection data of the eyes are employed to detect the inner and outer corners of the eyes. Detection data of the inner and outer corners of the eyes is employed to detect characteristic points of the upper and lower eyelids that represent the outline of the eyes.

摘要翻译： 首先，检测作为检测对象的图像内的面部。 使用脸部的检测数据来检测包含在脸部中的眼睛。 眼睛的检测数据用于检测眼睛的内角和外角。 使用眼睛内外角的检测数据来检测表示眼睛轮廓的上眼睑和下眼睑的特征点。

公开(公告)号：US07751640B2

公开(公告)日：2010-07-06

申请号：US11527601

申请日：2006-09-27

申请人： Yuanzhong Li ,  Wataru Ito

发明人： Yuanzhong Li ,  Wataru Ito

IPC分类号： G06K9/40 ,  H04N1/40

CPC分类号： H04N1/4092 ,  G06K9/00248 ,  G06K9/621

摘要： Sharpness is adjusted for more appropriately representing a predetermined structure in an image. A parameter acquisition unit obtains a weighting parameter for a principal component representing a degree of sharpness in a face region detected by a face detection unit as an example of the predetermined structure in the image, by fitting to the face region a mathematical model generated by a statistical method such as AAM based on a plurality of sample images representing human faces in different degrees of sharpness. Based on a value of the parameter, sharpness is adjusted in at least a part of the image. For example, a parameter changing unit changes the value of the parameter to a preset optimal face sharpness value, and an image reconstruction unit reconstructs the image based on the parameter having been changed and outputs the image having been subjected to the sharpness adjustment processing.

摘要翻译： 调整锐度以更适当地表示图像中的预定结构。 参数获取单元通过将由面部检测单元检测到的面部区域的清晰度表示为图像中的预定结构的示例的主成分的加权参数，通过将面部区域拟合为由 统计方法，例如基于表示不同锐度度的人脸的多个样本图像的AAM。 根据该参数的值，在图像的至少一部分中调整锐度。 例如，参数改变单元将参数的值改变为预设的最佳面部锐度值，并且图像重建单元基于已经改变的参数来重建图像，并输出已经进行了锐度调整处理的图像。

公开(公告)号：US20070206939A1

公开(公告)日：2007-09-06

申请号：US11712388

申请日：2007-03-01

申请人： Wataru Ito ,  Yuanzhong Li

发明人： Wataru Ito ,  Yuanzhong Li

IPC分类号： G03B13/34

CPC分类号： G03B13/34 ,  G06K9/00221 ,  G06K9/036 ,  G06K9/6247 ,  H04N5/23212 ,  H04N5/23219 ,  H04N5/23245 ,  H04N2101/00

摘要： In the AF processing section, the parameter obtaining section obtains a weighting parameter value for a principal component that represents a sharpness level of a face portion of an image, an example of a predetermined structure in an image, detected by the face detection section by applying the detected face portion to a model generated by a predetermined statistical processing, such as AAM or the like, based on a plurality of images that represent the face portion in different sharpness levels, and the control amount determination section determines the focus control amount according to the obtained parameter value.

摘要翻译： 在AF处理部中，参数获取部获取表示图像的脸部的锐度等级的主成分的加权参数值，图像中的预定结构的一例，由脸部检测部检测出的加法参数值， 基于表示不同清晰度级别的脸部的多个图像，通过诸如AAM等的预定统计处理生成的模型的检测到的脸部部分，并且控制量确定部根据 获得的参数值。

公开(公告)号：US20070070440A1

公开(公告)日：2007-03-29

申请号：US11527601

申请日：2006-09-27

申请人： Yuanzhong Li ,  Wataru Ito

发明人： Yuanzhong Li ,  Wataru Ito

IPC分类号： H04N1/40

CPC分类号： H04N1/4092 ,  G06K9/00248 ,  G06K9/621

摘要： Sharpness is adjusted for more appropriately representing a predetermined structure in an image. A parameter acquisition unit obtains a weighting parameter for a principal component representing a degree of sharpness in a face region detected by a face detection unit as an example of the predetermined structure in the image, by fitting to the face region a mathematical model generated by a statistical method such as AAM based on a plurality of sample images representing human faces in different degrees of sharpness. Based on a value of the parameter, sharpness is adjusted in at least a part of the image. For example, a parameter changing unit changes the value of the parameter to a preset optimal face sharpness value, and an image reconstruction unit reconstructs the image based on the parameter having been changed and outputs the image having been subjected to the sharpness adjustment processing.

摘要翻译： 调整锐度以更适当地表示图像中的预定结构。 参数获取单元通过将由面部检测单元检测到的面部区域的清晰度表示为图像中的预定结构的示例的主成分的加权参数，通过将面部区域拟合为由 统计方法，例如基于表示不同锐度度的人脸的多个样本图像的AAM。 根据该参数的值，在图像的至少一部分中调整锐度。 例如，参数改变单元将参数的值改变为预设的最佳面部锐度值，并且图像重建单元基于已经改变的参数来重建图像，并输出已经进行了锐度调整处理的图像。

公开(公告)号：US08254644B2

公开(公告)日：2012-08-28

申请号：US12278616

申请日：2007-02-07

申请人： Yuanzhong Li ,  Sadato Akahori ,  Kensuke Terakawa ,  Yoshiro Kitamura ,  Wataru Ito

发明人： Yuanzhong Li ,  Sadato Akahori ,  Kensuke Terakawa ,  Yoshiro Kitamura ,  Wataru Ito

IPC分类号： G06K9/00 ,  G06K9/46

CPC分类号： G06K9/00281

摘要： First, a face within an image, which is a target of detection, is detected. Detection data of the face is employed to detect eyes which are included in the face. Detection data of the eyes are employed to detect the inner and outer corners of the eyes. Detection data of the inner and outer corners of the eyes is employed to detect characteristic points of the upper and lower eyelids that represent the outline of the eyes.

摘要翻译： 首先，检测作为检测对象的图像内的面部。 使用脸部的检测数据来检测包含在脸部中的眼睛。 眼睛的检测数据用于检测眼睛的内角和外角。 使用眼睛内外角的检测数据来检测表示眼睛轮廓的上眼睑和下眼睑的特征点。