公开(公告)号：US07812839B2

公开(公告)日：2010-10-12

申请号：US11634996

申请日：2006-12-07

申请人： Chang Woo Chu ,  Jae Chul Kim ,  In Kyu Park ,  Bon Ki Koo

发明人： Chang Woo Chu ,  Jae Chul Kim ,  In Kyu Park ,  Bon Ki Koo

IPC分类号： G06T11/20

CPC分类号： G01B11/24 ,  G06T11/203

摘要： Provided is a method for creating a 3-D curved surface by using corresponding curves in a plurality of images. The method includes performing an NURBS fitting curve with respect to one image in a plurality of images having camera calibration and extracted camera parameter by using control points designated in a curve characterizing a subject shape. When the curve fitting is performed with respect to the curve that commonly exists in more than two images, a 3-D curve is created by using a camera calibration information, or a 3-D curved surface is created by creating a plurality of 3-D curves or straight lines. Therefore, a 3-D curved surface model can be easily and quickly created by simplifying a complex modeling process for an actual object modeling into an actual image-based modeling process.

摘要翻译： 提供了一种通过使用多个图像中的相应曲线来创建3-D曲面的方法。 该方法包括通过使用表征主题形状的曲线中指定的控制点，对具有相机校准的多个图像中的一个图像执行NURBS拟合曲线并提取相机参数。 当相对于通常存在于两个以上图像中的曲线执行曲线拟合时，通过使用相机校准信息创建3-D曲线，或者通过创建多个3- D曲线或直线。 因此，通过将实际对象建模简化为实际的基于图像的建模过程的复杂建模过程，可以容易且快速地创建3-D曲面模型。

公开(公告)号：US20070132763A1

公开(公告)日：2007-06-14

申请号：US11634996

申请日：2006-12-07

申请人： Chang Woo Chu ,  Jae Chul Kim ,  In Kyu Park ,  Bon Ki Koo

发明人： Chang Woo Chu ,  Jae Chul Kim ,  In Kyu Park ,  Bon Ki Koo

IPC分类号： G06T11/20

CPC分类号： G01B11/24 ,  G06T11/203

摘要： Provided is a method for creating a 3-D curved surface by using corresponding curves in a plurality of images. The method includes performing an NURBS fitting curve with respect to one image in a plurality of images having camera calibration and extracted camera parameter by using control points designated in a curve characterizing a subject shape. When the curve fitting is performed with respect to the curve that commonly exists in more than two images, a 3-D curve is created by using a camera calibration information, or a 3-D curved surface is created by creating a plurality of 3-D curves or straight lines. Therefore, a 3-D curved surface model can be easily and quickly created by simplifying a complex modeling process for an actual object modeling into an actual image-based modeling process.

摘要翻译： 提供了一种通过使用多个图像中的相应曲线来创建3-D曲面的方法。 该方法包括通过使用表征主题形状的曲线中指定的控制点，对具有相机校准的多个图像中的一个图像执行NURBS拟合曲线并提取相机参数。 当相对于通常存在于两个以上图像中的曲线执行曲线拟合时，通过使用相机校准信息创建3-D曲线，或者通过创建多个3- D曲线或直线。 因此，通过将实际对象建模简化为实际的基于图像的建模过程的复杂建模过程，可以容易且快速地创建3-D曲面模型。

公开(公告)号：US20070136034A1

公开(公告)日：2007-06-14

申请号：US11496395

申请日：2006-08-01

申请人： Jae Chul Kim ,  Chang Woo Chu ,  Bon Ki Koo

发明人： Jae Chul Kim ,  Chang Woo Chu ,  Bon Ki Koo

IPC分类号： G06F17/10 ,  G06F7/60

CPC分类号： G06T17/20 ,  G06T7/586

摘要： A method for modeling a three dimensional shape of object using a level set solution on a partial differential equation derived from a Helmholtz reciprocity condition is provided. The method includes the steps of: a) inputting an image pair satisfying a Helmholtz reciprocity condition; b) performing an optical correction and simultaneously performing a geometric correction; c) performing a camera selection to select cameras capable of seeing a point (X, Y, Z), and defining and calculating a cost function by the Helmholtz reciprocity condition; d) calculating a speed function of a PDE that minimizes the cost function obtained in the step c); and e) generating a three dimension mesh model from a set of points configuring the object surface provided from the step d), and deciding a final three dimension mesh model by comparing cost function values.

摘要翻译： 提供了一种使用从亥姆霍兹互惠条件导出的偏微分方程上的等级集解决方案对三维形状进行建模的方法。 该方法包括以下步骤：a）输入满足亥姆霍兹互易条件的图像对; b）执行光学校正并同时执行几何校正; c）执行相机选择以选择能够看到点（X，Y，Z）的相机，并且通过亥姆霍兹互易条件来定义和计算成本函数; d）计算使步骤c）中获得的成本函数最小的PDE的速度函数; 以及e）从构成由步骤d）提供的物体表面的一组点生成三维网格模型，以及通过比较成本函数值来确定最终的三维网格模型。

公开(公告)号：US07684614B2

公开(公告)日：2010-03-23

申请号：US11496395

申请日：2006-08-01

申请人： Jae Chul Kim ,  Chang Woo Chu ,  Bon Ki Koo

发明人： Jae Chul Kim ,  Chang Woo Chu ,  Bon Ki Koo

IPC分类号： G06T17/00

CPC分类号： G06T17/20 ,  G06T7/586

摘要： A method for modeling a three dimensional shape of object using a level set solution on a partial differential equation derived from a Helmholtz reciprocity condition is provided. The method includes the steps of: a) inputting an image pair satisfying a Helmholtz reciprocity condition; b) performing an optical correction and simultaneously performing a geometric correction; c) performing a camera selection to select cameras capable of seeing a point (X, Y, Z), and defining and calculating a cost function by the Helmholtz reciprocity condition; d) calculating a speed function of a PDE that minimizes the cost function obtained in the step c); and e) generating a three dimension mesh model from a set of points configuring the object surface provided from the step d), and deciding a final three dimension mesh model by comparing cost function values.

摘要翻译： 提供了一种使用从亥姆霍兹互惠条件导出的偏微分方程上的等级集解决方案对三维形状进行建模的方法。 该方法包括以下步骤：a）输入满足亥姆霍兹互易条件的图像对; b）执行光学校正并同时执行几何校正; c）执行相机选择以选择能够看到点（X，Y，Z）的相机，并且通过亥姆霍兹互易条件来定义和计算成本函数; d）计算使步骤c）中获得的成本函数最小的PDE的速度函数; 以及e）从构成由步骤d）提供的物体表面的一组点生成三维网格模型，以及通过比较成本函数值来确定最终的三维网格模型。

公开(公告)号：US08238648B2

公开(公告)日：2012-08-07

申请号：US11945759

申请日：2007-11-27

申请人： Jae Chul Kim ,  Chang Woo Chu ,  Ho Won Kim ,  Jeung Chul Park ,  Ji Young Park ,  Seong Jae Lim ,  Bon Ki Koo

发明人： Jae Chul Kim ,  Chang Woo Chu ,  Ho Won Kim ,  Jeung Chul Park ,  Ji Young Park ,  Seong Jae Lim ,  Bon Ki Koo

IPC分类号： G06K9/00

CPC分类号： G03B17/18 ,  G03B35/00 ,  G06T7/80 ,  H04N13/246

摘要： Provided is a camera self-calibration method that calculates a focal length of a fixed zoom lens camera from a correspondence point position between images. In the method, a cost function, which is a function of a focal length, is defined, and a focal length that minimizes the defined cost function is obtained to obtain a focal length that allows 3D recovery results of correspondence points calculated from all image pairs coincide with one another. Therefore, reliability of the calculated focal length can be easily verified, and the focal length of the camera can be stably calculated even when the position of input correspondence point is inaccurately given.

摘要翻译： 提供了一种从图像之间的对应点位置计算固定变焦镜头相机的焦距的照相机自校准方法。 在该方法中，定义作为焦距的函数的成本函数，并且获得使定义的成本函数最小化的焦距，以获得允许从所有图像对计算的对应点的3D恢复结果的焦距 相互重合。 因此，即使在输入对应点的位置不准确的情况下，也可以容易地验证计算出的焦距的可靠性，并能够稳定地计算摄像机的焦距。

公开(公告)号：US08270704B2

公开(公告)日：2012-09-18

申请号：US12314678

申请日：2008-12-15

申请人： Ho Won Kim ,  Chang Woo Chu ,  Bon Ki Koo

发明人： Ho Won Kim ,  Chang Woo Chu ,  Bon Ki Koo

IPC分类号： G06K9/00 ,  G06T15/00 ,  H04N13/00

CPC分类号： G06T17/20 ,  G06T15/205

摘要： A method for reconstructing a 3D shape model of an object by using multi-view image information, includes: inputting multi-view images obtained by photographing the object from multiple viewpoints in a voxel space, and extracting silhouette information and color information of the multi-view images; reconstructing visual hulls by silhouette intersection using the silhouette information; and approximating polygons of cross-sections of the visual hulls to a natural geometric shape of the object by using the color information. Further, the method includes expressing a 3D geometric shape of the object by connecting the approximated polygons to create a mesh structure; extracting color textures of a surface of the object by projecting meshes of the mesh structure to the multi-view image; and creating a 3D shape model by modeling natural shape information and surface color information of the object.

摘要翻译： 一种用于通过使用多视点图像信息来重建对象的3D形状模型的方法包括：输入通过在体素空间中从多个视点拍摄对象而获得的多视图图像，以及提取多视点图像信息的轮廓信息和颜色信息， 查看图像; 使用剪影信息通过剪影交点重建视觉船体; 以及通过使用颜色信息将视觉外壳的横截面的多边形近似为对象的自然几何形状。 此外，该方法包括通过连接近似多边形以形成网格结构来表达对象的3D几何形状; 通过将网格结构的网格投影到多视点图像来提取对象的表面的颜色纹理; 以及通过对对象的自然形状信息和表面颜色信息进行建模来创建3D形状模型。

公开(公告)号：US20110149093A1

公开(公告)日：2011-06-23

申请号：US12862963

申请日：2010-08-25

申请人： Hyun KANG ,  Ho Won Kim ,  Chang Woo Chu ,  Bon Ki Koo

发明人： Hyun KANG ,  Ho Won Kim ,  Chang Woo Chu ,  Bon Ki Koo

IPC分类号： H04N5/225

CPC分类号： H04N5/247

摘要： Disclosed are an apparatus and a method for automatic control of multiple cameras capable of supporting an effective camera view angle in a broadcast, a movie, etc. The automatic control apparatus of multiple cameras includes: a first main camera; a first camera driver controlling an operation of the first main camera; a second main camera; a second camera driver controlling an operation of the second main camera; at least one auxiliary camera; at least one third camera driver controlling an operation of the at least one auxiliary camera; and an interoperation processor changing a view angle of the at least one auxiliary camera by controlling the at least one third camera driver in accordance with a view angle changing reference changed by changing the view angle of the first main camera, the second main camera, or the first and second main cameras.

摘要翻译： 公开了一种用于自动控制能够支持广播，电影等中的有效摄像机视角的多个摄像机的装置和方法。多个摄像机的自动控制装置包括：第一主摄像机; 控制第一主摄像机的操作的第一摄像机驱动器; 第二主摄像头; 控制第二主摄像机的操作的第二摄像机驱动器; 至少一个辅助摄像机; 控制所述至少一个辅助摄像机的操作的至少一个第三摄像机驱动器; 以及互操作处理器，通过根据通过改变第一主摄像机，第二主摄像机或第二摄像机的视角改变的视角改变参考来控制至少一个第三摄像机驱动器来改变至少一个辅助摄像机的视角 第一和第二主摄像头。

公开(公告)号：US20110123168A1

公开(公告)日：2011-05-26

申请号：US13054408

申请日：2009-06-19

申请人： Maeng Sub Cho ,  Jin Seo Kim ,  Bon Ki Koo ,  Ji Hyung Lee ,  Chang Woo Chu ,  Ho Won Kim ,  II Kyu Park ,  Yoon-Seok Choi ,  Ji Young Park ,  Seong Jae Lim ,  Bon Woo Hwang ,  Jeung Chul Park ,  Kap Kee Kim ,  Sang-Kyun Kim ,  Yong-Soo Joo

发明人： Maeng Sub Cho ,  Jin Seo Kim ,  Bon Ki Koo ,  Ji Hyung Lee ,  Chang Woo Chu ,  Ho Won Kim ,  II Kyu Park ,  Yoon-Seok Choi ,  Ji Young Park ,  Seong Jae Lim ,  Bon Woo Hwang ,  Jeung Chul Park ,  Kap Kee Kim ,  Sang-Kyun Kim ,  Yong-Soo Joo

IPC分类号： H04N5/775 ,  H04N5/765 ,  H04N9/80

CPC分类号： H04N5/765 ,  G06F3/016 ,  H04N5/85 ,  H04N9/8205 ,  H04N21/41 ,  H04N21/42201 ,  H04N21/485 ,  H04N21/812 ,  H04N21/8133 ,  H04N21/8166 ,  H04N21/8186

摘要： A multimedia application system uses metadata for sensory devices. The system includes: a sensory-device engine for generating a sensory device command (SDC) for controlling the sensory devices based on sensory effect information (SEI) generated to represent sensory effects by using the sensory devices depending on video contents, user preference information (UPI) of the sensory devices and device capability information (DCI) indicative of reproducing capability of the sensory devices; and a sensory-device controller for controlling sensory devices to perform sensory effect reproduction in response to the generated SDC.

摘要翻译： 多媒体应用系统使用感觉设备的元数据。 该系统包括：感觉装置引擎，用于生成感测装置命令（SDC），用于基于通过使用根据视频内容的感觉装置产生的感觉效果信息（SEI）来控制感觉装置命令，用户偏好信息（ UPI）感测装置和设备能力信息（DCI），其指示感觉装置的再现能力; 以及感测装置控制器，用于控制感觉装置响应于所产生的SDC来执行感觉效果再现。

公开(公告)号：US20090153569A1

公开(公告)日：2009-06-18

申请号：US12314859

申请日：2008-12-17

申请人： Jeung Chul Park ,  Seong Jae Lim ,  Chang Woo Chu ,  Ho Won Kim ,  Ji Young Park ,  Bon Ki Koo

发明人： Jeung Chul Park ,  Seong Jae Lim ,  Chang Woo Chu ,  Ho Won Kim ,  Ji Young Park ,  Bon Ki Koo

IPC分类号： G06T15/70 ,  G06K9/00

CPC分类号： G06T13/40 ,  G06K2009/3291 ,  G06T7/251 ,  G06T7/277 ,  G06T2207/10016 ,  G06T2207/30201

摘要： A head motion tracking method for three-dimensional facial model animation, the head motion tracking method includes acquiring initial facial motion to be fit to an image of a three-dimensional model from an image inputted by a video camera; creating a silhouette of the three-dimensional model and projecting the silhouette; matching the silhouette created from the three-dimensional model with a silhouette acquired by a statistical feature point tracking scheme; and obtaining a motion parameter for the image of the three-dimensional model through motion correction using a texture to perform three-dimensional head motion tracking. In accordance with the present invention, natural three-dimensional facial model animation based on a real image acquired with a video camera can be performed automatically, thereby reducing time and cost.

摘要翻译： 一种用于三维面部模型动画的头部运动跟踪方法，所述头部运动跟踪方法包括从由摄像机输入的图像获取拟合到三维模型的图像的初始面部运动; 创建三维模型的轮廓并投影轮廓; 将由三维模型创建的轮廓与通过统计特征点跟踪方案获取的轮廓相匹配; 并且通过使用纹理的运动校正来获得三维模型的图像的运动参数，以执行三维头部运动跟踪。 根据本发明，可以自动执行基于用摄像机获取的真实图像的自然三维面部模型动画，从而减少时间和成本。

公开(公告)号：US08417034B2

公开(公告)日：2013-04-09

申请号：US12535877

申请日：2009-08-05

申请人： Kap Kee Kim ,  Bon Woo Hwang ,  Ji Hyung Lee ,  Jin Seo Kim ,  Seung Wook Lee ,  Chang Woo Chu ,  Ho Won Kim ,  Bon Ki Koo ,  Gil haeng Lee

发明人： Kap Kee Kim ,  Bon Woo Hwang ,  Ji Hyung Lee ,  Jin Seo Kim ,  Seung Wook Lee ,  Chang Woo Chu ,  Ho Won Kim ,  Bon Ki Koo ,  Gil haeng Lee

IPC分类号： G06K9/34

CPC分类号： G06K9/38

摘要： Disclosed herein is an apparatus and method for separating a foreground and a background. The apparatus includes a background model creation unit for creating a code book including a plurality of code words in order to separate the foreground and the background, and a foreground/background separation unit for separating the foreground and the background using the created code book. The method includes the steps of creating a code book including a plurality of code words in order to separate the foreground and the background, rearranging the cord words of the created code book on the basis of the number of sample data that belong to each of the code words, and separating the foreground and the background using the code book.

摘要翻译： 本文公开了一种用于分离前景和背景的装置和方法。 该装置包括：背景模型创建单元，用于创建包括多个代码字以便分离前景和背景的代码本;以及前景/背景分离单元，用于使用所创建的代码簿分离前景和背景。 该方法包括以下步骤：创建包括多个代码字的代码本以分离前景和背景，根据属于每个代码的样本数据的数量重新排列所创建的代码本的索词 代码字，并使用代码簿分离前景和背景。