公开(公告)号：US07643659B2

公开(公告)日：2010-01-05

申请号：US11323654

申请日：2005-12-31

申请人： Jiangen Cao ,  Shu Li ,  Huaqi Zhang ,  Jin Wang

发明人： Jiangen Cao ,  Shu Li ,  Huaqi Zhang ,  Jin Wang

IPC分类号： G06K9/00 ,  G06K9/56 ,  G06K9/40 ,  G06K9/20

CPC分类号： G06K9/00604 ,  G06K9/00234 ,  G06K9/00248 ,  G06K9/00281 ,  G06K9/4614

摘要： Locating an eye includes generating an intensity response map by applying a 3-rectangle filter and applying K-mean clustering to the map to determine the eye. Locating an eye corner includes applying logarithm transform and grayscale stretching to generate a grayscale eye patch, generating a binary map of the patch by using a threshold based on a histogram of the patch, and estimating the eye corner by averaging coordinates weighted by minimal eigenvalues of spatial gradient matrices in a search region based on the binary map. Locating a mouth corner includes generating another intensity response map and generating another binary map using another threshold based on another histogram of the intensity response map. Locating a chin or a cheek includes applying angle constrained gradient analysis to reject locations that cannot be the chin or cheek. Locating a cheek further includes removing falsely detected cheeks by parabola fitting curves through the cheeks.

摘要翻译： 定位眼睛包括通过应用3矩形滤波器并将K均值聚类应用于地图来确定眼睛来产生强度响应图。 定位眼角包括应用对数变换和灰度拉伸以产生灰度眼睛斑块，通过使用基于斑块的直方图的阈值来生成斑块的二值图，并且通过平均坐标加权的坐标来估计眼角，该坐标是通过最小特征值 基于二进制图的搜索区域中的空间梯度矩阵。 定位嘴角包括产生另一个强度响应图并使用基于强度响应图的另一个直方图的另一个阈值生成另一二进制图。 定位下巴或脸颊包括应用角度约束梯度分析来拒绝不能是下巴或脸颊的位置。 定位脸颊进一步包括通过抛物线拟合曲线通过脸颊去除错误检测到的脸颊。

公开(公告)号：US20090285455A1

公开(公告)日：2009-11-19

申请号：US12153297

申请日：2008-05-16

申请人： Shu Li ,  Han Qiu ,  Jin Wang

发明人： Shu Li ,  Han Qiu ,  Jin Wang

IPC分类号： G06K9/00

CPC分类号： G06K9/00281 ,  G06K9/00308 ,  G06T11/00

摘要： A method for detecting a facial expression and repairing a smile face of a portrait photo includes the steps of: detecting a location and a range of a mouth region in an inputted portrait photo; capturing a patch in the mouth region and a predetermined peripheral range thereof; executing a comparison process to a smile state or a stiff state of the mouth region in the patch by a mouth state classifier; executing a calculation process to a repaired region of the mouth region when the mouth region is determined to be in the stiff state, in order to calculate a location of a plurality of feature points in the repaired region of the mouth region; and executing an image warping process to the location of the feature points and adjacent pixels thereof, for generating a portrait photo showing a smile state.

摘要翻译： 用于检测人脸照片的脸部表情和修复微笑脸部的方法包括以下步骤：检测所输入的肖像照片中的口部区域的位置和范围; 在嘴区域和其预定的周边范围内捕获贴片; 通过嘴状态分类器对贴片中的口部区域的微笑状态或僵硬状态执行比较处理; 为了计算口部区域的修复区域中的多个特征点的位置，对嘴部区域的判定为处于刚性状态的口部区域进行计算处理， 以及对其特征点和相邻像素的位置执行图像变形处理，以产生显示微笑状态的肖像照片。

公开(公告)号：US20070154096A1

公开(公告)日：2007-07-05

申请号：US11323654

申请日：2005-12-31

申请人： Jiangen Cao ,  Shu Li ,  Huaqi Zhang ,  Jin Wang

发明人： Jiangen Cao ,  Shu Li ,  Huaqi Zhang ,  Jin Wang

IPC分类号： G06K9/46 ,  G06K9/62

CPC分类号： G06K9/00604 ,  G06K9/00234 ,  G06K9/00248 ,  G06K9/00281 ,  G06K9/4614

摘要： Locating an eye includes generating an intensity response map by applying a 3-rectangle filter and applying K-mean clustering to the map to determine the eye. Locating an eye corner includes applying logarithm transform and grayscale stretching to generate a grayscale eye patch, generating a binary map of the patch by using a threshold based on a histogram of the patch, and estimating the eye corner by averaging coordinates weighted by minimal eigenvalues of spatial gradient matrices in a search region based on the binary map. Locating a mouth corner includes generating another intensity response map and generating another binary map using another threshold based on another histogram of the intensity response map. Locating a chin or a cheek includes applying angle constrained gradient analysis to reject locations that cannot be the chin or cheek. Locating a cheek further includes removing falsely detected cheeks by parabola fitting curves through the cheeks.

摘要翻译： 定位眼睛包括通过应用3矩形滤波器并将K均值聚类应用于地图来确定眼睛来产生强度响应图。 定位眼角包括应用对数变换和灰度拉伸以产生灰度眼睛斑块，通过使用基于斑块的直方图的阈值来生成斑块的二值图，并且通过平均坐标加权的坐标来估计眼角，该坐标是通过最小特征值 基于二进制图的搜索区域中的空间梯度矩阵。 定位嘴角包括产生另一个强度响应图并使用基于强度响应图的另一个直方图的另一个阈值生成另一二进制图。 定位下巴或脸颊包括应用角度约束梯度分析来拒绝不能是下巴或脸颊的位置。 定位脸颊进一步包括通过抛物线拟合曲线通过脸颊去除错误检测到的脸颊。

公开(公告)号：US08170298B2

公开(公告)日：2012-05-01

申请号：US12153297

申请日：2008-05-16

申请人： Shu Li ,  Han Qiu ,  Jin Wang

发明人： Shu Li ,  Han Qiu ,  Jin Wang

IPC分类号： G06K9/00

CPC分类号： G06K9/00281 ,  G06K9/00308 ,  G06T11/00

摘要： A method for detecting a facial expression and repairing a smile face of a portrait photo includes the steps of: detecting a location and a range of a mouth region in an inputted portrait photo; capturing a patch in the mouth region and a predetermined peripheral range thereof; executing a comparison process to a smile state or a stiff state of the mouth region in the patch by a mouth state classifier; executing a calculation process to a repaired region of the mouth region when the mouth region is determined to be in the stiff state, in order to calculate a location of a plurality of feature points in the repaired region of the mouth region; and executing an image warping process to the location of the feature points and adjacent pixels thereof, for generating a portrait photo showing a smile state.

摘要翻译： 用于检测人脸照片的脸部表情和修复微笑脸部的方法包括以下步骤：检测所输入的肖像照片中的口部区域的位置和范围; 在嘴区域和其预定的周边范围内捕获贴片; 通过嘴状态分类器对贴片中的口部区域的微笑状态或僵硬状态执行比较处理; 为了计算口部区域的修复区域中的多个特征点的位置，对嘴部区域的判定为处于刚性状态的口部区域进行计算处理， 以及对其特征点和相邻像素的位置执行图像变形处理，以产生显示微笑状态的肖像照片。

公开(公告)号：US20110235924A1

公开(公告)日：2011-09-29

申请号：US12732180

申请日：2010-03-25

申请人： Xian-Ji Wang ,  Kun Yu ,  Shu Li ,  Jin Wang

发明人： Xian-Ji Wang ,  Kun Yu ,  Shu Li ,  Jin Wang

IPC分类号： G06K9/62 ,  G06K9/68

CPC分类号： G06K9/00677

摘要： After receiving a digital image, check if the digital image contains a predetermined object. If the digital image contains the predetermined object, extract object features from the predetermined object, then compare the object features with common features of each of the predetermined identifications. If the object features match the common features of one of the predetermined identifications, store the digital image into a database dedicated to the predetermined identification. If the object features do not match the common features of any of the predetermined identifications, register the predetermined object with a new identification. If the new identification is the same as one of the predetermined identifications, store the digital image into a database dedicated to the predetermined identification. If the new identification is different from all of the predetermined identifications, store the digital image into a database dedicated to the new identification.

摘要翻译： 收到数字图像后，检查数字图像是否包含预定对象。 如果数字图像包含预定对象，则从预定对象提取对象特征，然后将对象特征与每个预定标识的共同特征进行比较。 如果对象特征与预定标识之一的公共特征相匹配，则将数字图像存储到专用于预定标识的数据库中。 如果对象特征与任何预定标识的共同特征不匹配，则用新的标识登记预定对象。 如果新标识与预定标识之一相同，则将数字图像存储到专用于预定标识的数据库中。 如果新标识与所有预定标识不同，则将数字图像存储到专用于新标识的数据库中。

公开(公告)号：US07693301B2

公开(公告)日：2010-04-06

申请号：US11545423

申请日：2006-10-11

申请人： Shu Li ,  Jin Wang

发明人： Shu Li ,  Jin Wang

IPC分类号： G06K9/00

CPC分类号： G06K9/00261 ,  G06K9/3233

摘要： A known face guided imaging method applied for an electronic imaging device uses the scale of a known face sensed in a previous frame to define a scale range of a searching window, which adds a scale constraint into the searching window so as to search a current frame horizontally and vertically in the searching window to perform a face searching loop for a face. The invention simply sends a corresponding image patch within the scale range to a face detector for the face detection, and the searching space is constrained in a small group of scale ranges without the need of detecting the whole image of various different scales within the scale range, and thus the invention effectively reduces the huge quantity of computing values required for the detection process and greatly enhances the speed and efficiency of the face detection.

摘要翻译： 应用于电子成像装置的已知的面部引导成像方法使用在先前帧中感测到的已知脸部的比例来定义搜索窗口的比例范围，该搜索窗口将比例约束添加到搜索窗口中，以便搜索当前帧 在搜索窗口中水平和垂直地执行面部的面部搜索循环。 本发明简单地将尺度范围内的对应图像补丁发送到用于面部检测的面部检测器，并且搜索空间被限制在一小组范围内，而不需要检测尺度范围内的各种不同尺度的整个图像 因此本发明有效地减少了检测过程所需的大量计算值，大大提高了人脸检测的速度和效率。

公开(公告)号：US20070154095A1

公开(公告)日：2007-07-05

申请号：US11323653

申请日：2005-12-31

申请人： Jiangen Cao ,  Shu Li ,  Guogang Wang ,  Jin Wang

发明人： Jiangen Cao ,  Shu Li ,  Guogang Wang ,  Jin Wang

IPC分类号： G06K9/46 ,  G06K9/34 ,  G06K9/00

CPC分类号： G06K9/00234 ,  G06K9/00248 ,  G06K9/00281 ,  G06K9/00604 ,  G06K9/4614

摘要： A method for detecting a facial area on a color image includes (a) placing a search window on the color image, (b) determining if a center pixel of the search window is a skin color pixel, indicating that the search window is a possible facial area candidate, (c) applying a 3-rectangle filter to the search window to determine if the search window is a possible facial area candidate, (d) applying a 4-rectangle filter to the search window to determine if the search window is a possible facial area candidate, (e) if steps (b), (c), (d) all determine that the search window is a possible facial area candidate, applying an AdaBoost filter to the search window to determine if the search window is a facial area candidate, and (f) if step (e) determines that the search window is a facial area candidate, saving the location of the search window.

摘要翻译： 用于检测彩色图像上的面部区域的方法包括（a）在彩色图像上放置搜索窗口，（b）确定搜索窗口的中心像素是皮肤颜色像素，指示搜索窗口是可能的 面部区域候选者，（c）将三矩形滤波器应用于搜索窗口以确定搜索窗口是否是可能的面部区域候选，（d）将四矩形滤波器应用于搜索窗口以确定搜索窗口是否为 可能的面部区域候选者，（e）如果步骤（b），（c），（d）都确定搜索窗口是可能的面部区域候选者，则将AdaBoost过滤器应用于搜索窗口以确定搜索窗口是否为 面部候选人，以及（f）如果步骤（e）确定搜索窗口是面部区域候选者，则保存搜索窗口的位置。

公开(公告)号：US07953253B2

公开(公告)日：2011-05-31

申请号：US11323653

申请日：2005-12-31

申请人： Jiangen Cao ,  Shu Li ,  Guogang Wang ,  Jin Wang

发明人： Jiangen Cao ,  Shu Li ,  Guogang Wang ,  Jin Wang

IPC分类号： G06K9/00 ,  G06K9/56 ,  G06K9/36

CPC分类号： G06K9/00234 ,  G06K9/00248 ,  G06K9/00281 ,  G06K9/00604 ,  G06K9/4614

摘要： A method for detecting a facial area on a color image includes (a) placing a search window on the color image, (b) determining if a center pixel of the search window is a skin color pixel, indicating that the search window is a possible facial area candidate, (c) applying a 3-rectangle filter to the search window to determine if the search window is a possible facial area candidate, (d) applying a 4-rectangle filter to the search window to determine if the search window is a possible facial area candidate, (e) if steps (b), (c), (d) all determine that the search window is a possible facial area candidate, applying an AdaBoost filter to the search window to determine if the search window is a facial area candidate, and (f) if step (e) determines that the search window is a facial area candidate, saving the location of the search window.

摘要翻译： 用于检测彩色图像上的面部区域的方法包括（a）在彩色图像上放置搜索窗口，（b）确定搜索窗口的中心像素是皮肤颜色像素，指示搜索窗口是可能的 面部区域候选者，（c）将三矩形滤波器应用于搜索窗口以确定搜索窗口是否是可能的面部区域候选，（d）将四矩形滤波器应用于搜索窗口以确定搜索窗口是否为 可能的面部区域候选者，（e）如果步骤（b），（c），（d）都确定搜索窗口是可能的面部区域候选者，则将AdaBoost过滤器应用于搜索窗口以确定搜索窗口是否为 面部候选人，以及（f）如果步骤（e）确定搜索窗口是面部区域候选者，则保存搜索窗口的位置。

公开(公告)号：US20090060383A1

公开(公告)日：2009-03-05

申请号：US11892697

申请日：2007-08-27

申请人： Shu Li ,  Han Qiu ,  Jin Wang

发明人： Shu Li ,  Han Qiu ,  Jin Wang

IPC分类号： G06K9/20

CPC分类号： G06K9/00597 ,  G06T5/50 ,  G06T11/60

摘要： The present invention is to provide a method of restoring closed-eye portrait photo, which comprises the steps of detecting the locations and range of the eyes of a portrait photo being taken, retrieving a patch of a designated range of the eyes area and its neighboring area which represents the expression of the eyes and its neighboring area, determining whether the eyes of said patch are open or closed by using an eyes state classifier, temporarily storing said patch as an open-eye templet when it is determined that the eyes are open, detecting the locations and range of the eyes of a subsequently taken portrait photo, calculating an eyes restoration area when it is determined that the eyes are closed, replacing the closed-eye patch with said open-eye templet, and performing fusion operation toward said eyes restoration area to ensure that each portrait photo generated is with the eyes opened.

摘要翻译： 本发明提供恢复闭眼肖像照片的方法，其包括以下步骤：检测正在拍摄的肖像照片的眼睛的位置和范围，检索眼睛区域的指定范围及其邻近区域的斑块 表示眼睛及其相邻区域的表达的区域，通过使用眼睛状态分类器来确定所述贴片的眼睛是否打开或闭合，当确定眼睛被打开时临时存储所述贴片为开眼眼镜 检测随后拍摄的肖像照片的眼睛的位置和范围，当确定眼睛闭合时计算眼睛恢复区域，用所述开眼镜庙代替闭眼补丁，并对所述眼睛修补区域进行融合操作 眼睛恢复区域，以确保生成的每张人像照片都是用眼睛打开的。

公开(公告)号：US20080025576A1

公开(公告)日：2008-01-31

申请号：US11492076

申请日：2006-07-25

申请人： Shu Li ,  Jin Wang

发明人： Shu Li ,  Jin Wang

IPC分类号： G06K9/00

CPC分类号： G06K9/00281 ,  G06K9/00308 ,  G06K9/00597 ,  H04N5/232 ,  H04N5/23219 ,  H04N5/23222

摘要： In a method for detecting facial expressions of a portrait photo by an image capturing electronic device, a face captured in the portrait photo is detected. The position and range of the opened and closed facial features are detected, and the facial features within an identified range are magnified according to a specific proportion. A patch of facial features and their surroundings within a specific range is cut according to the magnified identified range, so that the patch can show a change of facial expressions and a specific range of their surroundings. A facial feature classifier is trained by a specific number of opened and closed facial feature samples based on the Adaboost algorithm and used for detecting the facial features in the patch to determine whether the facial feature is situated at an opened state or a closed state.

摘要翻译： 在通过图像拍摄电子设备检测人像照片的面部表情的方法中，检测在肖像照片中捕获的脸部。 检测打开和关闭的面部特征的位置和范围，并且根据特定比例放大识别范围内的面部特征。 根据放大的识别范围切割特定范围内的一些面部特征及其周围环境，以便贴片可以显示面部表情的变化及其周围环境的特定范围。 面部特征分类器基于Adaboost算法由特定数量的开放和闭合的面部特征样本训练，并用于检测贴片中的面部特征，以确定面部特征是处于打开状态还是关闭状态。