公开(公告)号：US20110107216A1

公开(公告)日：2011-05-05

申请号：US12785709

申请日：2010-05-24

Applicant: NING BI

Inventor： NING BI

IPC: G06F3/033 ,  G06F3/01

CPC classification number: G06F3/017 ,  G06F3/011 ,  G06F3/0481

Abstract: A gesture-based user interface system that includes a media-capturing device, a processor, and a display device. The media-capturing device captures media associated with a user and his/her surrounding environment. Using the captured media, the processor recognizes gestures the user uses to interact with display virtual objects displayed on the display device, without the user touching the display. A mirror image of the user and the surrounding environment is displayed in 3D on the display device with the display virtual objects in a virtual environment. The interaction between the image of the user and the display virtual objects is also displayed, in addition to an indication of the interaction such as a visual and/or an audio feedback.

Abstract translation: 一种基于手势的用户界面系统，其包括媒体捕获设备，处理器和显示设备。 媒体捕获设备捕获与用户及其周围环境相关联的媒体。 使用捕获的媒体，处理器识别用户用来与显示设备上显示的显示虚拟对象进行交互的手势，而无需用户触摸显示。 用户和周围环境的镜像在显示设备上以3D显示，虚拟环境中的显示虚拟对象。 除了诸如视觉和/或音频反馈之间的交互的指示之外，还显示用户的图像和显示虚拟对象之间的交互。