公开(公告)号：US10884497B2

公开(公告)日：2021-01-05

申请号：US16695545

申请日：2019-11-26

Applicant: Center of Human-Centered Interaction for Coexistence

Inventor： Dong Myoung Lee ,  Mincheol Kim ,  Juseong Lee ,  Bum Jae You

IPC: G06F3/01 ,  G06T7/00 ,  G06T15/20 ,  G06T17/00 ,  G06F3/0482 ,  G06F3/03 ,  G06T7/60 ,  G06F3/042

Abstract: A method and apparatus for motion capture interface using multiple fingers are disclosed. The method includes measuring a position of an end of a middle finger of an actual hand in a state in which the actual hand is spread, deriving a starting reference position of the middle finger of the actual hand, and calculating a length of the middle finger of the actual hand. The method further includes recognizing a relationship between starting reference positions of a thumb, an index finger, a middle finger, and a wrist based on using a virtual hand reference model that models a virtual hand to be controlled.

公开(公告)号：US20190206119A1

公开(公告)日：2019-07-04

申请号：US16311817

申请日：2017-06-12

Applicant: CENTER OF HUMAN-CENTERED INTERACTION FOR COEXISTENCE

Inventor： Sang Hun Nam ,  Joung Huem Kwon ,  Younguk Kim ,  Bum Jae You

IPC: G06T15/40 ,  G06T19/00

CPC classification number: G06T15/405 ,  G06T7/593 ,  G06T7/90 ,  G06T15/08 ,  G06T19/00 ,  G06T19/006

Abstract: A mixed reality display device according to one embodiment of the present invention comprises: a virtual environment rendering unit for generating a virtual object by using information on a scene in a virtual reality, and then generating a color map and a depth map for the virtual object; a depth rendering unit for generating a depth map for a real object by using information on a real environment; an occlusion processing unit for performing occlusion processing by using the color map and the depth map, for the virtual object, received from the virtual environment rendering unit, the depth map, for a real object, received from the depth rendering unit, and a color map, for the real object, received from a see-through camera; and a display unit for outputting a color image by using a color map for the virtual object and a color map for the real object, which are received from the occlusion processing unit.

公开(公告)号：US10251556B2

公开(公告)日：2019-04-09

申请号：US15664188

申请日：2017-07-31

Applicant: KOREA INSTITUTE OF SCIENCE AND TECHNOLOGY ,  CENTER OF HUMAN-CENTERED INTERACTION FOR COEXISTENCE

Inventor： Hwa Sup Lim ,  Seok Joon Kwon ,  Sang Chul Ahn ,  Bum Jae You

IPC: H04N7/18 ,  A61B5/00 ,  H04N5/33 ,  H04N5/225 ,  H04N5/374 ,  H01L27/146 ,  H01L31/0232

Abstract: Provided is an in vivo bioimaging method including irradiating near-infrared (NIR) light onto a living body, converting the NIR light passed through the living body, into visible light using upconversion nanoparticles (UCNPs), and generating a bioimage of the living body by receiving the visible light using a complementary metal-oxide-semiconductor (CMOS) image sensor.

公开(公告)号：US09927869B2

公开(公告)日：2018-03-27

申请号：US15620170

申请日：2017-06-12

Applicant: Center of Human-Centered Interaction For Coexistence

Inventor： Joung Huem Kwon ,  Yongho Lee ,  Bum Jae You

IPC: G06F3/01 ,  G06T19/00 ,  G06T15/40 ,  G06T19/20 ,  G06F3/16

CPC classification number: G06F3/011 ,  G06F3/014 ,  G06F3/016 ,  G06F3/017 ,  G06F3/0236 ,  G06F3/04812 ,  G06F3/167 ,  G06T15/40 ,  G06T19/006 ,  G06T19/20 ,  G06T2215/16 ,  G06T2219/2004 ,  G06T2219/2012 ,  G06T2219/2016

Abstract: Disclosed is an apparatus for outputting a virtual keyboard, the apparatus including: a virtual keyboard image output unit determining coordinates of a virtual keyboard image by using hand information of a user and outputting the virtual keyboard image; a contact recognition unit determining a contact state by using collision information between a virtual physical collider associated with an end point of a user's finger and a virtual physical collider associated with each virtual key of the virtual keyboard image; a keyboard input unit providing multiple input values for a single virtual key; and a feedback output unit outputting respective feedback for the multiple input values. Accordingly, input convenience and efficiency may be provided by outputting the virtual keyboard in a three dimensional virtual space and reproducing an input method using a keyboard form that is similar to the real world.

公开(公告)号：US09843772B2

公开(公告)日：2017-12-12

申请号：US14955013

申请日：2015-11-30

Applicant: Korea Advanced Institute of Science and Technology ,  Center of Human-centered Interaction for Coexistence

Inventor： Sung Hee Lee ,  Bum Jae You

IPC: H04N7/15 ,  G06K9/00 ,  G06Q10/10 ,  G06K9/62

CPC classification number: H04N7/157 ,  G06K9/00335 ,  G06K9/00362 ,  G06K2009/6213 ,  G06Q10/10

Abstract: A method for providing telepresence by employing avatars is provided. The method includes steps of: (a) a corresponding location searching part determining a location in a first space where an avatar Y′ corresponding to a human Y in a second space will be placed, if a change of a location of the human Y in the second space is detected from an initial state, by referring to (i) information on the first space and the second space and (ii) information on locations of the humans X and Y, and the avatar X′ in the first and the second spaces; and (b) an avatar motion creating part creating a motion of the avatar Y′ by referring to information on the determined location where the avatar Y′ will be placed.

公开(公告)号：US09030307B1

公开(公告)日：2015-05-12

申请号：US14574367

申请日：2014-12-17

Applicant: Center of Human-Centered Interaction for Coexistence

Inventor： Kwang Kyu Lee ,  Shin Young Kim ,  Dae Keun Yoon ,  Jai Hi Cho ,  Bum Jae You

IPC: H04B3/36 ,  G06F3/01 ,  G06F3/0346

CPC classification number: G06F3/016 ,  G06F3/014 ,  G06F3/017 ,  G06F3/0346 ,  G06F2203/0331

Abstract: An apparatus for generating haptic feedback, includes: multiple haptic units placed on a first portion of a body; and a control unit placed on a second portion, near the first portion, of the body, wherein the control unit includes: a first module for acquiring information on relative position (i) among the respective multiple haptic units and (ii) between the respective haptic units and the control unit, a second module for acquiring information on absolute position of the control unit by measuring a position of the control unit in reference to an external reference point, and a haptic command module for creating a command signal by referring to at least one piece of the information on relative position acquired by the first module and the information on absolute position acquired by the second module and delivering the created command signal to a corresponding haptic unit among all the multiple haptic units.

Abstract translation: 一种用于产生触觉反馈的装置，包括：放置在身体的第一部分上的多个触觉单元; 以及控制单元，放置在身体的第一部分附近的第二部分上，其中控制单元包括：第一模块，用于获取关于相应多个触觉单元之间的相对位置（i）的信息，以及（ii）相应的 触觉单元和控制单元，第二模块，用于通过参考外部参考点测量控制单元的位置来获取关于控制单元的绝对位置的信息;以及触觉命令模块，用于通过参考在外部参考点创建命令信号 由第一模块获取的关于相对位置的信息和由第二模块获取的关于绝对位置的信息的至少一条信息，并将所创建的命令信号传递到所有多个触觉单元中的对应的触觉单元。

公开(公告)号：US10019064B2

公开(公告)日：2018-07-10

申请号：US15233571

申请日：2016-08-10

Applicant: Center of Human-centered Interaction for Coexistence

Inventor： Kwang Kyu Lee ,  Shin Young Kim ,  Dae Keun Yoon ,  Bum Jae You

IPC: G06F3/01 ,  G06F3/03 ,  G06F3/0346 ,  G06F3/038 ,  G06F3/0354

CPC classification number: G06F3/016 ,  G06F3/0304 ,  G06F3/0346 ,  G06F3/03545 ,  G06F3/0386 ,  G06F2203/0384

Abstract: Provided is a hand-held type user interface device for providing force feedback to a user according to an interaction with a virtual object or a user at a remote place, which remarkably increases the sense of reality in the interaction with the virtual object without limiting an action of the user by sensing the three-dimensional (3D) position and direction of the device and diversifying a force feedback provided to the user according to an action of the user holding the device.

公开(公告)号：US09265974B2

公开(公告)日：2016-02-23

申请号：US14285807

申请日：2014-05-23

Applicant: Center Of Human-Centered Interaction For Coexistence ,  Korea Institute of Science and Technology ,  Catholic University Industry Academic Cooperation Foundation

Inventor： Bum Jae You ,  Sung On Lee ,  Yong An Chung

IPC: A61N7/00 ,  A61B5/00 ,  G06F1/00

CPC classification number: A61N7/00 ,  A61B5/4064 ,  A61N2007/0021 ,  A61N2007/0026 ,  G06F1/00

Abstract: The present invention relates to an apparatus for creating a tactile sensation through non-invasive brain stimulation by using ultrasonic waves. The apparatus includes: an ultrasonic transducer module for inputting the ultrasonic waves to stimulate a specific part of the brain of a specified user non-invasively through at least one ultrasonic transducer unit; a compensating module for acquiring information on a range of tactile perception areas in the brain of the specified user and compensating properties of ultrasonic waves to be inputted to the specified user through the ultrasonic transducer unit by referring to the acquired information thereon; and an ultrasonic waves generating module for generating ultrasonic waves to be inputted to the specified user through the ultrasonic transducer unit by referring to a compensating value decided by the compensating module.

Abstract translation: 本发明涉及一种通过使用超声波通过非侵入性脑刺激产生触感的装置。 该装置包括：超声换能器模块，用于输入超声波，以通过至少一个超声波换能器单元非侵入地刺激指定用户的脑的特定部分; 补偿模块，用于获取关于指定用户的大脑中的触觉感知区域的信息的信息，并且通过参考所获取的信息来补偿要通过超声波换能器单元输入到指定用户的超声波的属性; 以及超声波产生模块，用于通过参考由补偿模块决定的补偿值，通过超声波换能器单元产生要输入到指定用户的超声波。

公开(公告)号：US09189008B1

公开(公告)日：2015-11-17

申请号：US14573440

申请日：2014-12-17

Applicant: Center Of Human-Centered Interaction For Coexistence

Inventor： Dae Keun Yoon ,  Kwang Kyu Lee ,  Shin Young Kim ,  Jai Hi Cho ,  Bum Jae You

IPC: G05B15/00 ,  G05G1/34 ,  G05G11/00

CPC classification number: G06F3/011 ,  B25J13/04 ,  G05G1/34 ,  G05G11/00 ,  G06F3/016

Abstract: An apparatus interacting with an external device by using a pedal module is provided. The apparatus includes: a pedal module; a parallel position-measuring sensor for sensing a degree of a parallel motion; a rotary position-measuring sensor for sensing a degree of a rotary motion; and a control part for ordering the external device to be driven by referring to at least either of the degree of the parallel motion sensed by the parallel position-measuring sensor or that of the rotary motion sensed by the rotary position-measuring sensor or for receiving a control signal from the external device and driving a motor group including at least one motor to apply force feedback to the pedal module by referring to the control signal.

Abstract translation: 提供了通过使用踏板模块与外部设备相互作用的设备。 该装置包括：踏板模块; 用于感测平行运动程度的平行位置测量传感器; 用于感测旋转运动程度的旋转位置测量传感器; 以及控制部件，用于通过参考平行位置测量传感器感测到的并行运动程度或由旋转位置测量传感器感测到的旋转运动的程度中的至少一个来驱动外部设备，或者用于接收 来自外部设备的控制信号并且驱动包括至少一个电动机的电动机组，以通过参考控制信号向踏板模块施加力反馈。

公开(公告)号：US20140375639A1

公开(公告)日：2014-12-25

申请号：US14252837

申请日：2014-04-15

Applicant: Center Of Human-Centered Interaction For Coexistence

Inventor： Joung Huem Kwon ,  Romain Destenay ,  Jai Hi Cho ,  Bum Jae You

IPC: G06T15/60 ,  G06T15/50

CPC classification number: G06T15/60 ,  G06T15/50

Abstract: A method for displaying a shadow of a 3D virtual object, includes steps of: (a) acquiring information on a viewpoint of a user looking at a 3D virtual object displayed in a specific location in 3D space by a wall display device; (b) determining a location and a shape of a shadow of the 3D virtual object to be displayed by referring to information on the viewpoint of the user and the information on a shape of the 3D virtual object; and (c) allowing the shadow of the 3D virtual object to be displayed by at least one of the wall display device and a floor display device by referring to the determined location and the determined shape of the shadow of the 3D virtual object. Accordingly, the user is allowed to feel the accurate sense of depth or distance regarding the 3D virtual object.

Abstract translation: 一种用于显示3D虚拟对象的阴影的方法，包括以下步骤：（a）通过墙壁显示装置获取在3D空间中显示在3D空间中的3D虚拟对象的用户的视点的信息; （b）通过参照关于用户视点的信息和关于3D虚拟对象的形状的信息来确定要显示的3D虚拟对象的阴影的位置和形状; 以及（c）通过参照所确定的位置和确定的3D虚拟物体的阴影的形状，允许墙壁显示装置和地板显示装置中的至少一个显示3D虚拟物体的阴影。 因此，允许用户感觉到关于3D虚拟物体的准确的深度感或距离感。