公开(公告)号：US20190206119A1

公开(公告)日：2019-07-04

申请号：US16311817

申请日：2017-06-12

Applicant: CENTER OF HUMAN-CENTERED INTERACTION FOR COEXISTENCE

Inventor： Sang Hun Nam ,  Joung Huem Kwon ,  Younguk Kim ,  Bum Jae You

IPC: G06T15/40 ,  G06T19/00

CPC classification number: G06T15/405 ,  G06T7/593 ,  G06T7/90 ,  G06T15/08 ,  G06T19/00 ,  G06T19/006

Abstract: A mixed reality display device according to one embodiment of the present invention comprises: a virtual environment rendering unit for generating a virtual object by using information on a scene in a virtual reality, and then generating a color map and a depth map for the virtual object; a depth rendering unit for generating a depth map for a real object by using information on a real environment; an occlusion processing unit for performing occlusion processing by using the color map and the depth map, for the virtual object, received from the virtual environment rendering unit, the depth map, for a real object, received from the depth rendering unit, and a color map, for the real object, received from a see-through camera; and a display unit for outputting a color image by using a color map for the virtual object and a color map for the real object, which are received from the occlusion processing unit.

公开(公告)号：US09927869B2

公开(公告)日：2018-03-27

申请号：US15620170

申请日：2017-06-12

Applicant: Center of Human-Centered Interaction For Coexistence

Inventor： Joung Huem Kwon ,  Yongho Lee ,  Bum Jae You

IPC: G06F3/01 ,  G06T19/00 ,  G06T15/40 ,  G06T19/20 ,  G06F3/16

CPC classification number: G06F3/011 ,  G06F3/014 ,  G06F3/016 ,  G06F3/017 ,  G06F3/0236 ,  G06F3/04812 ,  G06F3/167 ,  G06T15/40 ,  G06T19/006 ,  G06T19/20 ,  G06T2215/16 ,  G06T2219/2004 ,  G06T2219/2012 ,  G06T2219/2016

Abstract: Disclosed is an apparatus for outputting a virtual keyboard, the apparatus including: a virtual keyboard image output unit determining coordinates of a virtual keyboard image by using hand information of a user and outputting the virtual keyboard image; a contact recognition unit determining a contact state by using collision information between a virtual physical collider associated with an end point of a user's finger and a virtual physical collider associated with each virtual key of the virtual keyboard image; a keyboard input unit providing multiple input values for a single virtual key; and a feedback output unit outputting respective feedback for the multiple input values. Accordingly, input convenience and efficiency may be provided by outputting the virtual keyboard in a three dimensional virtual space and reproducing an input method using a keyboard form that is similar to the real world.

公开(公告)号：US20140375639A1

公开(公告)日：2014-12-25

申请号：US14252837

申请日：2014-04-15

Applicant: Center Of Human-Centered Interaction For Coexistence

Inventor： Joung Huem Kwon ,  Romain Destenay ,  Jai Hi Cho ,  Bum Jae You

IPC: G06T15/60 ,  G06T15/50

CPC classification number: G06T15/60 ,  G06T15/50

Abstract: A method for displaying a shadow of a 3D virtual object, includes steps of: (a) acquiring information on a viewpoint of a user looking at a 3D virtual object displayed in a specific location in 3D space by a wall display device; (b) determining a location and a shape of a shadow of the 3D virtual object to be displayed by referring to information on the viewpoint of the user and the information on a shape of the 3D virtual object; and (c) allowing the shadow of the 3D virtual object to be displayed by at least one of the wall display device and a floor display device by referring to the determined location and the determined shape of the shadow of the 3D virtual object. Accordingly, the user is allowed to feel the accurate sense of depth or distance regarding the 3D virtual object.

Abstract translation: 一种用于显示3D虚拟对象的阴影的方法，包括以下步骤：（a）通过墙壁显示装置获取在3D空间中显示在3D空间中的3D虚拟对象的用户的视点的信息; （b）通过参照关于用户视点的信息和关于3D虚拟对象的形状的信息来确定要显示的3D虚拟对象的阴影的位置和形状; 以及（c）通过参照所确定的位置和确定的3D虚拟物体的阴影的形状，允许墙壁显示装置和地板显示装置中的至少一个显示3D虚拟物体的阴影。 因此，允许用户感觉到关于3D虚拟物体的准确的深度感或距离感。

公开(公告)号：US20190124153A1

公开(公告)日：2019-04-25

申请号：US16306931

申请日：2017-04-24

Applicant: CENTER OF HUMAN-CENTERED INTERACTION FOR COEXISTENCE

Inventor： Sang Hun Nam ,  Joung Huem Kwon ,  Eunseok Choi ,  Bum Jae You

IPC: H04L29/08

Abstract: The present invention relates to a data processing device, method, and computer program for data sharing among multiple users. The device includes a sensor module collecting data by using at least one of a camera sensor, a distance sensor, a microphone array, a motion capture sensor, an environment scanner, and a haptic device; a memory module storing and controlling the data collected by the sensor module; and a network module transmitting the data stored in the memory module to a remote location, or receiving predetermined data from the remote location, wherein the memory module stores the stored data and the predetermined data as data in a standardized format according to data features.

公开(公告)号：US20160358380A1

公开(公告)日：2016-12-08

申请号：US15171054

申请日：2016-06-02

Applicant: Center of Human-Centered Interaction for Coexistence

Inventor： Ki Won Yeom ,  Joung Huem Kwon ,  Ji Yong Lee ,  Bum Jae You

IPC: G06T19/00 ,  G06T15/00 ,  G06F3/01

CPC classification number: G06T19/006 ,  G02B27/01 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0187 ,  G06F3/012 ,  G06F3/013

Abstract: A head-mounted device (HMD) for enabling a 3D drawing interaction in a mixed-reality space is provided. The HMD includes a frame section, a rendering unit providing a specified image, a camera unit attached to the frame section to pick up an image for rendering, and a control unit configured to, when the camera unit picks up an image of a specified marker, perform a calibration process based on position information of the image of the marker displayed on a screen of the HMD and to, when there is a motion of an input device for interaction with a virtual whiteboard, obtain position information of an image of the input device displayed on a virtual camera screen based on position information of the whiteboard.

Abstract translation: 提供了一种用于在混合现实空间中实现3D绘图交互的头戴式装置（HMD）。 HMD包括帧部分，提供指定图像的渲染单元，附接到帧部分以拾取用于渲染的图像的相机单元，以及控制单元，被配置为当相机单元拾取指定标记的图像时 ，基于在HMD的画面上显示的标记的图像的位置信息进行校准处理，并且当存在用于与虚拟白板交互的输入装置的运动时，获取输入的图像的位置信息 基于白板的位置信息在虚拟摄像机屏幕上显示的设备。

公开(公告)号：US09123180B2

公开(公告)日：2015-09-01

申请号：US14252837

申请日：2014-04-15

Applicant: Center Of Human-Centered Interaction For Coexistence

Inventor： Joung Huem Kwon ,  Romain Destenay ,  Jai Hi Cho ,  Bum Jae You

IPC: G06T15/00 ,  G06T15/60 ,  G06T15/50

CPC classification number: G06T15/60 ,  G06T15/50

Abstract: A method for displaying a shadow of a 3D virtual object, includes steps of: (a) acquiring information on a viewpoint of a user looking at a 3D virtual object displayed in a specific location in 3D space by a wall display device; (b) determining a location and a shape of a shadow of the 3D virtual object to be displayed by referring to information on the viewpoint of the user and the information on a shape of the 3D virtual object; and (c) allowing the shadow of the 3D virtual object to be displayed by at least one of the wall display device and a floor display device by referring to the determined location and the determined shape of the shadow of the 3D virtual object. Accordingly, the user is allowed to feel the accurate sense of depth or distance regarding the 3D virtual object.

Abstract translation: 一种用于显示3D虚拟对象的阴影的方法，包括以下步骤：（a）通过墙壁显示装置获取在3D空间中显示在3D空间中的3D虚拟对象的用户的视点的信息; （b）通过参照关于用户视点的信息和关于3D虚拟对象的形状的信息来确定要显示的3D虚拟对象的阴影的位置和形状; 以及（c）通过参照所确定的位置和确定的3D虚拟物体的阴影的形状，允许墙壁显示装置和地板显示装置中的至少一个显示3D虚拟物体的阴影。 因此，允许用户感觉到关于3D虚拟对象的准确的深度感或距离感。

公开(公告)号：US20170371405A1

公开(公告)日：2017-12-28

申请号：US15620170

申请日：2017-06-12

Applicant: Center of Human-Centered Interaction for Coexistence

Inventor： Joung Huem Kwon ,  Yongho Lee ,  Bum Jae You

IPC: G06F3/01 ,  G06T19/00 ,  G06T19/20 ,  G06T15/40 ,  G06F3/16

CPC classification number: G06F3/011 ,  G06F3/014 ,  G06F3/016 ,  G06F3/017 ,  G06F3/0236 ,  G06F3/04812 ,  G06F3/167 ,  G06T15/40 ,  G06T19/006 ,  G06T19/20 ,  G06T2215/16 ,  G06T2219/2004 ,  G06T2219/2012 ,  G06T2219/2016

Abstract: Disclosed is an apparatus for outputting a virtual keyboard, the apparatus including: a virtual keyboard image output unit determining coordinates of a virtual keyboard image by using hand information of a user and outputting the virtual keyboard image; a contact recognition unit determining a contact state by using collision information between a virtual physical collider associated with an end point of a user's finger and a virtual physical collider associated with each virtual key of the virtual keyboard image; a keyboard input unit providing multiple input values for a single virtual key; and a feedback output unit outputting respective feedback for the multiple input values. Accordingly, input convenience and efficiency may be provided by outputting the virtual keyboard in a three dimensional virtual space and reproducing an input method using a keyboard form that is similar to the real world.

公开(公告)号：US20160357258A1

公开(公告)日：2016-12-08

申请号：US15171167

申请日：2016-06-02

Applicant: Center of Human-Centered Interaction for Coexistence

Inventor： Ki Won Yeom ,  Joung Huem Kwon ,  Ji Yong Lee ,  Bum Jae You

IPC: G06F3/01

CPC classification number: G06F3/016 ,  G06F3/011

Abstract: An apparatus for providing haptic force feedback to a user interacting with a virtual object in a virtual space is provided. The apparatus includes a force-feedback provision unit providing a sensation of touch arising from an interaction with the virtual object to at least a portion of the user's body. A processor unit performs (i) receiving at least one of a first force-feedback control data generated based on vector information on a motion of the at least a portion of the user's body and information on the virtual object and a second force-feedback control data generated based on image information the information on the virtual object from the external terminal, or (ii) generating at least one of the first and second force-feedback control data.

Abstract translation: 提供了一种用于在虚拟空间中向与虚拟对象交互的用户提供触觉力反馈的装置。 该装置包括力反馈提供单元，其向与用户身体的至少一部分提供与虚拟对象的交互产生的触摸感。 处理器单元执行（i）接收基于用户身体的至少一部分的运动的矢量信息生成的第一力反馈控制数据和关于虚拟物体的信息和第二力反馈控制中的至少一个 基于图像信息生成的关于来自外部终端的虚拟对象的信息的数据，或者（ii）生成第一和第二力反馈控制数据中的至少一个。

公开(公告)号：US10032313B2

公开(公告)日：2018-07-24

申请号：US15171054

申请日：2016-06-02

Applicant: Center of Human-Centered Interaction for Coexistence

Inventor： Ki Won Yeom ,  Joung Huem Kwon ,  Ji Yong Lee ,  Bum Jae You

IPC: G09G5/00 ,  G06T19/00 ,  G06F3/01 ,  G02B27/01

Abstract: A head-mounted device (HMD) for enabling a 3D drawing interaction in a mixed-reality space is provided. The HMD includes a frame section, a rendering unit providing a specified image, a camera unit attached to the frame section to pick up an image for rendering, and a control unit configured to, when the camera unit picks up an image of a specified marker, perform a calibration process based on position information of the image of the marker displayed on a screen of the HMD and to, when there is a motion of an input device for interaction with a virtual whiteboard, obtain position information of an image of the input device displayed on a virtual camera screen based on position information of the whiteboard.

公开(公告)号：US08884746B1

公开(公告)日：2014-11-11

申请号：US14252922

申请日：2014-04-15

Applicant: Center of Human-Centered Interaction for Coexistence

Inventor： Jai Hi Cho ,  Joung Huem Kwon ,  Shin Young Kim ,  Bum Jae You

IPC: H04B3/36 ,  G08B6/00 ,  G06F3/01

CPC classification number: G08B6/00 ,  G06F3/014 ,  G06F3/016

Abstract: An apparatus for generating tactile sensation by using a magnetic field, includes: a first magnet and a second one which are placed across a target as a subject to provide tactile sensation; and a first electromagnet placed between the target and the first magnet; wherein a strength of the whole magnetic field between the first and the second magnets is allowed to be adjusted by adjusting at least either of a direction and a strength of a magnetic field arising from the first electromagnet to control the strength of the force with which the target is pressed by the first and the second magnets. Because a magnet itself that generates a magnetic field without any complicated mechanical components may perform a function as an actuator that generates tactile sensation, the apparatus for generating tactile sensation may become simple, light and compact.

Abstract translation: 一种用于通过使用磁场产生触觉的装置，包括：第一磁体和第二磁体，被放置在作为被摄体的目标上以提供触觉; 以及放置在所述靶和所述第一磁体之间的第一电磁体; 其中通过调节由第一电磁体产生的磁场的方向和强度中的至少一个来控​​制第一和第二磁体之间的整个磁场的强度，以控制强度 目标被第一和第二磁体按压。 因为产生没有任何复杂的机械部件的磁场的磁体本身可以执行产生触感的致动器的功能，所以用于产生触感的装置可能变得简单，轻巧和紧凑。