公开(公告)号：US20240013438A1

公开(公告)日：2024-01-11

申请号：US18346508

申请日：2023-07-03

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Hyun KANG ,  Jae-Hean KIM ,  Bon-Ki KOO

IPC: G06T7/80

CPC classification number: G06T7/80

Abstract: Disclosed herein is a method for automatically recognizing correspondence between calibration pattern feature points in camera calibration. The method for automatically recognizing correspondence between calibration pattern feature points in camera calibration includes generating calibration pattern candidates from an input image using a point-line-face-multi-face hierarchical structure, and performing verification on the calibration pattern candidates based on a preset verification condition.

公开(公告)号：US20150172637A1

公开(公告)日：2015-06-18

申请号：US14569258

申请日：2014-12-12

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Seung-Uk YOON ,  Bon-Woo HWANG ,  Seong-Jae LIM ,  Kap-Kee KIM ,  Hye-Ryeong JUN ,  Jin-Sung CHOI ,  Bon-Ki KOO

IPC: H04N13/02 ,  G06T17/00 ,  G06T7/00 ,  G06T7/40

CPC classification number: G06T17/00 ,  G06T7/149 ,  G06T2207/10028 ,  G06T2207/30201

Abstract: Disclosed are an apparatus and a method for generating three-dimensional output data, in which the appearance or face of a user is easily restored in a three-dimensional manner by using one or a plurality of cameras including a depth sensor, a three-dimensional avatar for an individual, which is produced through three-dimensional model transition, and data capable of being three-dimensionally output, which is generated based on the three-dimensional avatar for an individual. The apparatus includes an acquisition unit that acquires a three-dimensional model based on depth information and a color image from at least one point of view, a selection unit that selects at least one of three-dimensional template models, and a generation unit that modifies at least one of a plurality of three-dimensional template models selected by the selection unit and generates three-dimensional output data based on the three-dimensional model acquired by the acquisition unit.

Abstract translation: 公开了一种用于生成三维输出数据的装置和方法，其中通过使用一个或多个摄像机容易地以三维方式恢复用户的外观或面部，其包括深度传感器，三维 通过三维模型转换产生的个体的头像和能够被三维输出的数据，其基于个人的三维头像生成。 该装置包括从至少一个观点基于深度信息和彩色图像获取三维模型的获取单元，选择三维模板模型中的至少一个的选择单元和修改 由选择单元选择的多个三维模板模型中的至少一个，并且基于由获取单元获取的三维模型生成三维输出数据。

公开(公告)号：US20150032241A1

公开(公告)日：2015-01-29

申请号：US14325816

申请日：2014-07-08

Applicant: Electronics and Telecommunications Research Institute

Inventor： Seung-Wook LEE ,  In-Su JANG ,  Jin-Sung CHOI ,  Bon-Ki KOO

IPC: B29C67/00

CPC classification number: B29C67/0088 ,  B29C64/386 ,  B33Y50/02

Abstract: Disclosed herein is a device and method for supporting 3D object printing and an apparatus for providing a 3D object printing service. A proposed device for supporting 3D object printing includes an information collection unit for collecting preference information of a user and performance information of a 3D printer. A download unit downloads a 3D model that is an object to be printed and model information defined in the 3D model in response to a printable selection signal. A model information creation unit creates new model information based on the 3D model and the model information defined in the 3D model. A print control command generation unit generates a print control command based on the preference information of the user and the performance information of the 3D printer, output from the information collection unit, and the new model information, output from the model information creation unit.

Abstract translation: 本文公开了一种用于支持3D对象打印的装置和方法以及用于提供3D对象打印服务的装置。 用于支持3D对象打印的所提出的装置包括用于收集用户的偏好信息和3D打印机的性能信息的信息收集单元。 下载单元响应于可打印的选择信号下载作为要打印的对象的3D模型和在3D模型中定义的模型信息。 模型信息创建单元基于3D模型和在3D模型中定义的模型信息创建新的模型信息。 打印控制命令生成单元基于从模型信息创建单元输出的用户的偏好信息和从信息收集单元输出的3D打印机的性能信息和新的模型信息，生成打印控制命令。

公开(公告)号：US20150187061A1

公开(公告)日：2015-07-02

申请号：US14317238

申请日：2014-06-27

Applicant: Electronics and Telecommunications Research Institute

Inventor： Seong-Jin PARK ,  Bon-Ki KOO ,  Jin-Sung CHOI ,  Do-Hyung KIM ,  Il-Kyu PARK

IPC: G06T7/00 ,  G06T15/08 ,  G06T3/00

CPC classification number: G06T3/0068 ,  G06T7/344 ,  G06T2207/10028 ,  G06T2207/20212 ,  G06T2207/30036

Abstract: An apparatus includes: an input/output interface configured to have a reference surface model and a floating surface model inputted thereto; a memory having instructions for registration of the reference surface model and the floating surface model stored therein; and a processor configured for registration of the reference surface model and the floating surface model according to the instructions. The instructions perform: selecting initial transformation parameters corresponding to the floating surface model by comparing depth images of the reference surface model and the floating surface model; transforming the floating surface model according to the initial transformation parameters; calculating compensation transformation parameters through a matrix calculated by applying singular value decomposition to a cross covariance matrix between the reference surface model and the floating surface model; and transforming the floating surface model according to the compensation transformation parameters, and executing registration of the reference surface model and the floating surface model.

Abstract translation: 一种装置包括：输入/输出接口，被配置为具有输入到其的参考表面模型和浮动表面模型; 存储器，其具有用于登记参考表面模型和存储在其中的浮动表面模型的指令; 以及处理器，其被配置为根据所述指令注册所述参考表面模型和所述浮动表面模型。 指令执行：通过比较参考表面模型和浮动表面模型的深度图像来选择与浮动表面模型对应的初始变换参数; 根据初始变换参数变换浮动表面模型; 通过将参考表面模型和浮动表面模型之间的交叉协方差矩阵应用奇异值分解计算出的矩阵来计算补偿变换参数; 并根据补偿变换参数变换浮动表面模型，并执行参考表面模型和浮动表面模型的注册。

公开(公告)号：US20130195330A1

公开(公告)日：2013-08-01

申请号：US13753378

申请日：2013-01-29

Applicant: Electronics and Telecommunications Research Institute

Inventor： Ho-Won KIM ,  Seung-Wook LEE ,  Ji-Hyung LEE ,  Bon-Ki KOO

IPC: G06K9/00

CPC classification number: G06K9/00362 ,  G06K9/00201 ,  G06T2200/04 ,  G06T2207/20044 ,  G06T2207/30196

Abstract: Disclosed herein is an apparatus and method for estimating the joint structure of a human body. The apparatus includes a multi-view image acquisition unit for receiving multi-view images acquired by capturing a human body. A human body foreground separation unit extracts a foreground region corresponding to the human body from the acquired multi-view images. A human body shape restoration unit restores voxels indicating geometric space occupation information of the human body using the foreground region corresponding to the human body, thus generating voxel-based three-dimensional (3D) shape information of the human body. A skeleton information extraction unit generates 3D skeleton information from the generated voxel-based 3D shape information of the human body. A skeletal structure estimation unit estimates positions of respective joints from a skeletal structure of the human body using both the generated 3D skeleton information and anthropometric information.

Abstract translation: 这里公开了一种用于估计人体关节结构的装置和方法。 该装置包括：多视点图像获取单元，用于接收通过捕获人体获取的多视点图像。 人体前景分离部从所获取的多视图图像中提取与人体对应的前景区域。 人体形状修复单元使用与人体对应的前景区域恢复表示人体的几何空间占用信息的体素，从而生成人体的基于体素的三维（3D）形状信息。 骨架信息提取单元根据生成的基于体素的基于体素的3D形状信息生成3D骨架信息。 骨骼结构估计单元使用生成的3D骨架信息和人体测量信息来估计来自人体的骨骼结构的各个关节的位置。

公开(公告)号：US20200159022A1

公开(公告)日：2020-05-21

申请号：US16664607

申请日：2019-10-25

Applicant: Electronics and Telecommunications Research Institute

Inventor： Hye-Sun PARK ,  Hyun KANG ,  Byung-Kuk SEO ,  Bon-Ki KOO

IPC: G02B27/01 ,  G06T19/00 ,  G02B5/30 ,  G02B27/00 ,  G06F3/01

Abstract: Disclosed herein are a method and apparatus for providing a user-customized augmented-reality service. The method is configured to extract the basic ergonomic information of a user by sensing the body of the user who is using an augmented-reality service, to generate user-customized ergonomic information by modifying the basic ergonomic information of the user based on at least one of misrecognition occurring in predefined basic interaction and user evaluation information, to detect the physical characteristics of the user by comparing the basic ergonomic information of the user with the user-customized ergonomic information, to define user-customized interaction by reflecting the physical characteristics of the user in the predefined basic interaction, to extract the unique characteristics of the user from usage data accumulated through the user-customized interaction, and to update the user-customized interaction so as to match the unique characteristics of the user.

公开(公告)号：US20200005543A1

公开(公告)日：2020-01-02

申请号：US16447847

申请日：2019-06-20

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Jae-Hean KIM ,  Bon-Ki KOO ,  Chang-Joon PARK

IPC: G06T19/00 ,  G06T7/73 ,  G06F3/01

Abstract: Disclosed herein are an apparatus and method for calibrating an augmented-reality image. The apparatus includes a camera unit for capturing an image and measuring 3D information pertaining to the image, an augmented-reality image calibration unit for generating an augmented-reality image using the image and the 3D information and for calibrating the augmented-reality image, and a display unit for displaying the augmented-reality image.

公开(公告)号：US20130301906A1

公开(公告)日：2013-11-14

申请号：US13888333

申请日：2013-05-06

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Seung-Uk YOON ,  Kap-Kee KIM ,  Bon-Woo HWANG ,  Ji-Hyung LEE ,  Bon-Ki KOO

IPC: G06T7/00

CPC classification number: G06T7/529 ,  G06T7/593 ,  G06T17/00 ,  G06T2200/08 ,  G06T2207/10012 ,  G06T2207/10024 ,  G06T2207/30201

Abstract: Disclosed herein are an apparatus and method for reconstructing a three-dimensional (3D) face based on multiple cameras. The apparatus includes a multi-image analysis unit, a texture image separation unit, a reconstruction image automatic synchronization unit, a 3D appearance reconstruction unit, and a texture processing unit. The multi-image analysis unit determines the resolution information of images received from a plurality of cameras, and determines whether the images have been synchronized with each other. The texture image separation unit separates a texture processing image by comparing the resolutions of the received images. The reconstruction image automatic synchronization unit synchronizes images that are determined to be asynchronous images by the multi-image analysis unit. The 3D appearance reconstruction unit computes the 3D coordinate values of the synchronized images, and reconstructs a 3D appearance image. The texture processing unit reconstructs a 3D image by mapping the texture processing image to the 3D appearance image.

Abstract translation: 本文公开了一种用于基于多个照相机重建三维（3D）面部的装置和方法。 该装置包括多图像分析单元，纹理图像分离单元，重建图像自动同步单元，3D外观重建单元和纹理处理单元。 多图像分析单元确定从多个摄像机接收的图像的分辨率信息，并且确定图像是否已经彼此同步。 纹理图像分离单元通过比较接收到的图像的分辨率来分离纹理处理图像。 重建图像自动同步单元通过多图像分析单元同步确定为异步图像的图像。 3D外观重建单元计算同步图像的3D坐标值，并重建3D外观图像。 纹理处理单元通过将纹理处理图像映射到3D外观图像来重建3D图像。

公开(公告)号：US20150279016A1

公开(公告)日：2015-10-01

申请号：US14444030

申请日：2014-07-28

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Jae-Hean KIM ,  Chang-Woo CHU ,  Young-Mi CHA ,  Jin-Sung CHOI ,  Bon-Ki KOO

IPC: G06T7/00 ,  H04N13/02

CPC classification number: G06T7/85 ,  G06T7/521 ,  G06T7/80 ,  G06T2207/10024 ,  G06T2207/10028 ,  H04N13/246 ,  H04N13/254 ,  H04N13/271 ,  H04N2213/003

Abstract: An image processing apparatus and method for calibrating a depth of a depth sensor. The image processing method may include obtaining a depth image of a target object captured by a depth sensor and a color image of the target object captured by a color camera; and calibrating a depth of the depth sensor by calibrating a geometrical relation between a projector and a depth camera, which are included in the depth sensor, based the obtained depth and color images and calculating a correct feature point on an image plane of the depth camera that corresponds to a feature point of an image plane of the projector.

Abstract translation: 一种用于校准深度传感器的深度的图像处理装置和方法。 图像处理方法可以包括获得由深度传感器捕获的目标对象的深度图像和由彩色相机拍摄的目标对象的彩色图像; 并且通过基于获得的深度和彩色图像校准包含在深度传感器中的投影仪和深度相机之间的几何关系并且在深度相机的图像平面上计算正确的特征点来校准深度传感器的深度 其对应于投影仪的图像平面的特征点。

公开(公告)号：US20150254502A1

公开(公告)日：2015-09-10

申请号：US14637344

申请日：2015-03-03

Applicant: Electronics and Telecommunications Research Institute

Inventor： Seong-Jae LIM ,  Bon-Woo HWANG ,  Kap-Kee KIM ,  Seung-Uk YOON ,  Hye-Ryeong JUN ,  Jin-Sung CHOI ,  Bon-Ki KOO

IPC: G06K9/00 ,  G05B19/18

CPC classification number: G06K9/00302 ,  B33Y80/00 ,  G05B19/40931 ,  G05B2219/2636 ,  G05B2219/49023 ,  G06K9/00 ,  G06K9/00214 ,  G06K9/00268 ,  G06T19/20 ,  Y02P90/265

Abstract: Disclosed herein is an apparatus and method for automatically creating a 3D personalized figure suitable for 3D printing by detecting a face area and features for respective regions from face data acquired by heterogeneous sensors and by optimizing global/local transformation. The 3D personalized figure creation apparatus acquires face data of a user corresponding to a reconstruction target; extracts feature points for respective regions from the face data, and reconstructs unique 3D models of the user's face, based on the extracted feature points; creates 3D figure models based on the unique 3D models and previously stored facial expression models and body/adornment models; and verifies whether each 3D figure model has a structure and a shape corresponding to actual 3D printing, corrects and edits the 3D figure model based on results of verification, and outputs a 3D figure model corresponding to 3D printing.

Abstract translation: 本文公开了一种用于通过从由异质传感器获取的面部数据和优化全局/局部变换来检测来自相应区域的面部区域和特征来自动创建适于3D打印的3D个性化图案的装置和方法。 3D个性化图形生成装置获取与重建对象对应的用户的面部数据; 从面部数据中提取各个区域的特征点，并基于提取的特征点重建用户脸部的独特3D模型; 基于独特的3D模型和先前存储的面部表情模型和身体/装饰模型创建3D图形模型; 并验证每个3D图形模型是否具有与实际3D打印相对应的结构和形状，基于验证结果校正和编辑3D图形模型，并输出与3D打印相对应的3D图形模型。