公开(公告)号：US20130050434A1

公开(公告)日：2013-02-28

申请号：US13563367

申请日：2012-07-31

Applicant: Kap Kee KIM ,  Seung Uk Yoon ,  Bon Woo Hwang ,  Ji Hyung Lee ,  Bon Ki Koo

Inventor： Kap Kee KIM ,  Seung Uk Yoon ,  Bon Woo Hwang ,  Ji Hyung Lee ,  Bon Ki Koo

IPC: G06T17/00 ,  H04N13/02

CPC classification number: G06T17/00 ,  G06T2200/08

Abstract: The present invention provides a local multi-resolution 3-D face-inherent model generation apparatus, including one or more 3-D facial model generation cameras for photographing a face of an object at various angles in order to obtain one or more 3-D face models, a 3-D face-inherent model generation unit for generating a 3-D face-inherent model by composing the one or more 3-D face models, a local photographing camera for photographing a local part of the face of the object, a control unit for controlling the position of the local photographing camera on the 3-D face-inherent model, and a local multi-resolution 3-D face-inherent model generation unit for generating a local multi-resolution face-inherent model by composing an image captured by the local photographing camera and the 3-D face-inherent model, a local multi-resolution 3-D face-inherent model generation using the local multi-resolution 3-D face-inherent model generation apparatus, and a skin management system.

Abstract translation: 本发明提供了一种局部多分辨率3-D面部固有模型生成装置，包括一个或多个三维面部模型生成摄像机，用于以各种角度拍摄对象的脸部，以获得一个或多个3-D 面部模型，3-D面部固有模型生成单元，用于通过组合一个或多个3-D脸部模型来产生3-D面部固有模型，用于拍摄对象的脸部的局部部分的本地摄影相机 用于控制3-D面部固有模型上的本地拍摄相机的位置的控制单元和用于通过以下方式产生局部多分辨率面部固有模型的局部多分辨率3-D面部固有模型生成单元 组合本地拍摄照相机和3-D面部固有模型拍摄的图像，使用本地多分辨率3-D面部固有模型生成装置的局部多分辨率3-D面部固有模型生成，以及 皮肤管理系统。

公开(公告)号：US20120154393A1

公开(公告)日：2012-06-21

申请号：US13333825

申请日：2011-12-21

Applicant: Ji-Hyung LEE ,  Bon-Ki Koo ,  Yoon-Seok Choi ,  Jeung-Chul Park ,  Do-Hyung Kim ,  Bon-Woo Hwang ,  Kap-Kee Kim ,  Seong-Jae Lim ,  Han-Byul Joo ,  Seung-Uk Yoon

Inventor： Ji-Hyung LEE ,  Bon-Ki Koo ,  Yoon-Seok Choi ,  Jeung-Chul Park ,  Do-Hyung Kim ,  Bon-Woo Hwang ,  Kap-Kee Kim ,  Seong-Jae Lim ,  Han-Byul Joo ,  Seung-Uk Yoon

IPC: G06T13/00 ,  G06T15/00

CPC classification number: G06T13/40 ,  G06T7/251 ,  G06T17/20

Abstract: Disclosed herein are an apparatus and method for creating animation by capturing the motions of a non-rigid object. The apparatus includes a geometry mesh reconstruction unit, a motion capture unit, and a content creation unit. The geometry mesh reconstruction unit receives moving images captured by a plurality of cameras, and generates a reconstruction mesh set for each frame. The motion capture unit generates mesh graph sets for the reconstruction mesh set and generates motion data, including motion information, using the mesh graph sets. The content creation unit creates three-dimensional (3D) content for a non-rigid object by generating a final transformation mesh set, having a topology similar to that of the reconstruction mesh set, using the motion data.

Abstract translation: 本文公开了一种通过捕获非刚性对象的运动来创建动画的装置和方法。 该装置包括几何网格重建单元，运动捕捉单元和内容创建单元。 几何网格重建单元接收由多个摄像机拍摄的运动图像，并为每个帧生成重建网格集。 运动捕捉单元生成用于重建网格集的网格图集，并使用网格图集生成运动数据，包括运动信息。 内容创建单元通过使用运动数据生成具有类似于重建网格集的拓扑的拓扑结构的最终变换网格集，来为非刚性对象创建三维（3D）内容。

公开(公告)号：US20120113106A1

公开(公告)日：2012-05-10

申请号：US13288698

申请日：2011-11-03

Applicant: Yoon-Seok CHOI ,  Ji Hyung Lee

Inventor： Yoon-Seok CHOI ,  Ji Hyung Lee

IPC: G06T17/00

CPC classification number: G06T17/00 ,  G06T11/00

Abstract: A face avatar generating apparatus includes: a face feature information extraction unit for receiving a face photo and extracting face feature information from the face photo and a two-dimensional (2D) avatar generation unit for selecting at least one region from the face photo based on the face feature information, and exaggerating or beautifying the selected region to create a 2D avatar image. The apparatus further includes a 3D avatar generation unit for modifying a standard 3D face model through a comparison with the standard 3D model based on the face feature information and pre-stored standard information to create a 3D avatar image.

Abstract translation: 面部头像生成装置包括：面部特征信息提取单元，用于接收脸部照片并从面部照片提取面部特征信息;以及二维（2D）头像生成单元，用于从面部照片中选择至少一个区域，基于 面部特征信息，以及夸张或美化所选择的区域以创建2D头像图像。 该装置还包括3D头像生成单元，用于通过与基于面部特征信息和预先存储的标准信息的标准3D模型的比较来修改标准3D脸部模型，以创建3D头像图像。

公开(公告)号：US20110123168A1

公开(公告)日：2011-05-26

申请号：US13054408

申请日：2009-06-19

Applicant: Maeng Sub Cho ,  Jin Seo Kim ,  Bon Ki Koo ,  Ji Hyung Lee ,  Chang Woo Chu ,  Ho Won Kim ,  II Kyu Park ,  Yoon-Seok Choi ,  Ji Young Park ,  Seong Jae Lim ,  Bon Woo Hwang ,  Jeung Chul Park ,  Kap Kee Kim ,  Sang-Kyun Kim ,  Yong-Soo Joo

Inventor： Maeng Sub Cho ,  Jin Seo Kim ,  Bon Ki Koo ,  Ji Hyung Lee ,  Chang Woo Chu ,  Ho Won Kim ,  II Kyu Park ,  Yoon-Seok Choi ,  Ji Young Park ,  Seong Jae Lim ,  Bon Woo Hwang ,  Jeung Chul Park ,  Kap Kee Kim ,  Sang-Kyun Kim ,  Yong-Soo Joo

IPC: H04N5/775 ,  H04N5/765 ,  H04N9/80

CPC classification number: H04N5/765 ,  G06F3/016 ,  H04N5/85 ,  H04N9/8205 ,  H04N21/41 ,  H04N21/42201 ,  H04N21/485 ,  H04N21/812 ,  H04N21/8133 ,  H04N21/8166 ,  H04N21/8186

Abstract: A multimedia application system uses metadata for sensory devices. The system includes: a sensory-device engine for generating a sensory device command (SDC) for controlling the sensory devices based on sensory effect information (SEI) generated to represent sensory effects by using the sensory devices depending on video contents, user preference information (UPI) of the sensory devices and device capability information (DCI) indicative of reproducing capability of the sensory devices; and a sensory-device controller for controlling sensory devices to perform sensory effect reproduction in response to the generated SDC.

Abstract translation: 多媒体应用系统使用感觉设备的元数据。 该系统包括：感觉装置引擎，用于生成感测装置命令（SDC），用于基于通过使用根据视频内容的感觉装置产生的感觉效果信息（SEI）来控制感觉装置命令，用户偏好信息（ UPI）感测装置和设备能力信息（DCI），其指示感觉装置的再现能力; 以及感测装置控制器，用于控制感觉装置响应于所产生的SDC来执行感觉效果再现。

公开(公告)号：US20090141021A1

公开(公告)日：2009-06-04

申请号：US12275760

申请日：2008-11-21

Applicant: Manjai LEE ,  Seung Wook Lee ,  Bon Ki Koo ,  Kwang Ho Yang ,  Ji Hyung Lee ,  Heung-Nam Kim

Inventor： Manjai LEE ,  Seung Wook Lee ,  Bon Ki Koo ,  Kwang Ho Yang ,  Ji Hyung Lee ,  Heung-Nam Kim

IPC: G06T15/00

CPC classification number: G06T19/00 ,  G09B29/001 ,  H04L67/38

Abstract: A method for providing knowledge includes creating a three-dimensional virtual space, generating temporal and spatial information including knowledge and space information concerning the three-dimensional virtual space at a specific time point, and associating the temporal and spatial information with the three-dimensional virtual space to be stored in a memory. The creating the three-dimensional virtual space may be created based on a map or a two-dimensional image.

Abstract translation: 提供知识的方法包括创建三维虚拟空间，在特定时间点产生包括与三维虚拟空间有关的知识和空间信息的时间和空间信息，以及将时间和空间信息与三维虚拟空间相关联 要存储在存储器中的空间。 可以基于地图或二维图像来创建三维虚拟空间的创建。

公开(公告)号：US07423650B2

公开(公告)日：2008-09-09

申请号：US11438278

申请日：2006-05-23

Applicant: Ji Hyung Lee ,  Sung Ye Kim ,  Bo Youn Kim ,  Hee Jeong Kim ,  Bon Ki Koo

Inventor： Ji Hyung Lee ,  Sung Ye Kim ,  Bo Youn Kim ,  Hee Jeong Kim ,  Bon Ki Koo

IPC: G06T15/00

CPC classification number: G06T13/40 ,  Y10S345/95

Abstract: There is provided a method of representing and animating a 2D (Two-Dimensional) character in a 3D (Three-Dimensional) space for a character animation. The method includes performing a pre-processing operation in which data of a character that is required to represent and animate the 2D character like a 3D character is prepared and stored and producing the character animation using the stored data.

Abstract translation: 提供了一种在用于角色动画的3D（三维）空间中表示和动画2D（二维）字符的方法。 该方法包括执行预处理操作，其中准备并存储用于表示和动画2D字符所需要的字符的数据，并且使用所存储的数据产生字符动画。

公开(公告)号：US08902305B2

公开(公告)日：2014-12-02

申请号：US13566938

申请日：2012-08-03

Applicant: Bon Woo Hwang ,  Kap Kee Kim ,  Seung-Uk Yoon ,  Bonki Koo ,  Ji Hyung Lee

Inventor： Bon Woo Hwang ,  Kap Kee Kim ,  Seung-Uk Yoon ,  Bonki Koo ,  Ji Hyung Lee

IPC: H04N13/00 ,  H04N13/02 ,  G06K9/00 ,  G06T17/00

CPC classification number: G06K9/00275 ,  G06K9/00993 ,  G06T17/00

Abstract: A system for managing face data includes a global face capturing unit configured to capture a global face image; and a global face data generation unit configured to obtain shape information and texture information of global face data, and generate the global face data. Further, the system includes a local face capturing unit configured to capture a plurality of local face images; and a global face posture extraction unit configured to estimate a position and a direction of the face of a captured user. Furthermore, the system includes a local capturing device posture extraction unit configured to extract posture information of the local face capturing unit; and a local face data generation unit configured to generate texture information and shape information, and generate local face data.

Abstract translation: 一种用于管理面部数据的系统包括被配置为捕获全局人脸图像的全局人脸捕获单元; 以及全局人脸数据生成部，被配置为获得全局面部数据的形状信息和纹理信息，并生成全局面部数据。 此外，该系统包括被配置为捕获多个局部脸部图像的局部脸部捕获单元; 以及全局面部姿势提取单元，被配置为估计所捕获的用户的脸部的位置和方向。 此外，该系统包括：本地捕获装置姿势提取单元，被配置为提取局部面部拍摄单元的姿势信息; 以及局部面部数据生成部，其生成纹理信息和形状信息，生成局部面部数据。

公开(公告)号：US08830269B2

公开(公告)日：2014-09-09

申请号：US12495063

申请日：2009-06-30

Applicant: Seong Jae Lim ,  Ho Won Kim ,  Il Kyu Park ,  Ji Young Park ,  Ji Hyung Lee ,  Jin Seo Kim ,  Seung Wook Lee ,  Chang Woo Chu ,  Bon Woo Hwang ,  Bon Ki Koo

Inventor： Seong Jae Lim ,  Ho Won Kim ,  Il Kyu Park ,  Ji Young Park ,  Ji Hyung Lee ,  Jin Seo Kim ,  Seung Wook Lee ,  Chang Woo Chu ,  Bon Woo Hwang ,  Bon Ki Koo

IPC: G09G5/00 ,  G06T13/40 ,  G06T19/20 ,  G06T17/30

CPC classification number: G06T17/30 ,  G06T13/40 ,  G06T19/20 ,  G06T2219/2021

Abstract: A method of deforming a shape of a human body model includes the steps of reorganizing human body model data into a joint-skeleton structure-based Non-Uniform Rational B-spline (NURBS) surface model, generating statistical deformation information about control parameters of the NURBS surface model based on parameters of joints and key section curves for specific motions, and deforming the shape of the human body model based on the NURBS surface model and the statistical deformation information. The human body model data includes three-dimensional (3D) human body scan data and a 3D polygon mesh.

Abstract translation: 人体模型形状变形的方法包括以下步骤：将人体模型数据重组为基于联合骨架结构的非均匀有理B样条（NURBS）表面模型，生成有关控制参数的统计变形信息 基于NURBS曲面模型和统计变形信息，根据关节参数和关键截面曲线对NURBS曲面模型进行特定运动，并对人体模型的形状进行变形。 人体模型数据包括三维（3D）人体扫描数据和3D多边形网格。

公开(公告)号：US08805024B2

公开(公告)日：2014-08-12

申请号：US13335120

申请日：2011-12-22

Applicant: Han-Byul Joo ,  Seong-Jae Lim ,  Ji-Hyung Lee ,  Bon-Ki Koo

Inventor： Han-Byul Joo ,  Seong-Jae Lim ,  Ji-Hyung Lee ,  Bon-Ki Koo

IPC: G06K9/00

CPC classification number: G06T7/251 ,  G06T7/13 ,  G06T2207/20044

Abstract: Disclosed herein is a motion capture apparatus and method. The motion capture apparatus includes a three-dimensional (3D) appearance reconstruction unit for reconstructing a 3D appearance of an entity using a multi-view image obtained by capturing the entity at a T+1-th frame. A 3D skeleton generation unit generates a 3D skeleton of the T+1-th frame using the 3D appearance and a model of the entity having a motion of a T-th frame. A motion reconstruction unit reconstructs a motion of the T+1-th frame of the model by changing the motion of the model based on the 3D skeleton of the T+1-th frame.

Abstract translation: 这里公开了一种运动捕捉装置和方法。 运动捕捉装置包括三维（3D）外观重建单元，用于使用通过在第T + 1帧捕获实体而获得的多视图图像来重构实体的3D外观。 3D骨架生成单元使用3D外观和具有第T帧的运动的实体的模型来生成第T + 1帧的3D骨架。 运动重建单元通过基于第T + 1帧的3D骨架改变模型的运动来重建模型的第T + 1帧的运动。

公开(公告)号：US08712146B2

公开(公告)日：2014-04-29

申请号：US12612792

申请日：2009-11-05

Applicant: Ho Won Kim ,  Seong Jae Lin ,  Bo Youn Kim ,  Il Kyu Park ,  Ji Young Park ,  Bon Ki Koo ,  Ji Hyung Lee ,  Jin Seo Kim ,  Seung Wook Lee ,  Chang Woo Chu ,  Bon Woo Hwang ,  Young Jik Lee

Inventor： Ho Won Kim ,  Seong Jae Lin ,  Bo Youn Kim ,  Il Kyu Park ,  Ji Young Park ,  Bon Ki Koo ,  Ji Hyung Lee ,  Jin Seo Kim ,  Seung Wook Lee ,  Chang Woo Chu ,  Bon Woo Hwang ,  Young Jik Lee

IPC: G06K9/00 ,  G06K9/46 ,  G06K9/36 ,  G06T15/00

CPC classification number: G06T13/40

Abstract: The present invention relates to a method of creating an animatable digital clone includes receiving input multi-view images of an actor captured by at least two cameras and reconstructing a three-dimensional appearance therefrom, accepting shape information selectively based on a probability of photo-consistency in the input multi-view images obtained from the reconstruction and transferring a mesh topology of a reference human body model onto a shape of the actor obtained from the reconstruction. The method further includes generating an initial human body model of the actor via transfer of the mesh topology utilizing sectional shape information of the actor's joints, and generating a genuine human body model of the actor from learning genuine behavioral characteristics of the actor by applying the initial human body model to multi-view posture learning images where performance of a predefined motion by the actor is recorded.

Abstract translation: 本发明涉及一种创建可动画数字克隆的方法，包括：接收由至少两个相机拍摄的演员的输入多视图图像，并从其重构三维外观，基于光一致性的概率有选择地接受形状信息 在从重构获得的输入多视图图像中，并将参考人体模型的网格拓扑转移到从重建获得的运动员的形状上。 该方法还包括通过使用演员关节的截面形状信息的网格拓扑的传递来生成演员的初始人体模型，以及通过应用初始的演员生成演员的真正的人体模型来学习演员的真实行为特征 人体模型以多视角姿态学习图像，其中记录由演员执行预定义的运动。