Invention Grant
- Patent Title: Method and apparatus for virtual training based on tangible interaction
-
Application No.: US17528401Application Date: 2021-11-17
-
Publication No.: US11887257B2Publication Date: 2024-01-30
- Inventor: Seong Min Baek , Youn-Hee Gil , Cho-Rong Yu , Hee Sook Shin , Sungjin Hong
- Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
- Applicant Address: KR Daejeon
- Assignee: Electronics and Telecommunications Research Institute
- Current Assignee: Electronics and Telecommunications Research Institute
- Current Assignee Address: KR Daejeon
- Agency: Rabin & Berdo, P.C.
- Priority: KR 20200154797 2020.11.18
- Main IPC: G06T19/00
- IPC: G06T19/00 ; G06T7/50 ; G06T7/73 ; G09B9/00

Abstract:
A method and an apparatus for virtual training based on tangible interaction are provided. The apparatus acquires data for virtual training, and acquires a three-dimensional position of a real object based on a depth image and color image of the real object and infrared (IR) data included in the obtained data. Then, virtualization of an overall appearance of a user is performed by extracting a depth from depth information on a user image included in the obtained data and matching the extracted depth with the color information, and depth data and color data for the user obtained according to virtualization of the user is visualized in virtual training content. In addition, the apparatus performs correction on joint information using the joint information and the depth information included in the obtained data, estimates a posture of the user using the corrected joint information, and estimates a posture of a training tool using the depth information and IR data included in the obtained data.
Public/Granted literature
- US20220157022A1 METHOD AND APPARATUS FOR VIRTUAL TRAINING BASED ON TANGIBLE INTERACTION Public/Granted day:2022-05-19
Information query