A gesture-based user interface system that includes a media-capturing device, a processor, and a display device. The media-capturing device captures media associated with a user and his/her surrounding environment. Using the captured media, the processor recognizes gestures the user uses to interact with display virtual objects displayed on the display device, without the user touching the display. A mirror image of the user and the surrounding environment is displayed in 3D on the display device with the display virtual objects in a virtual environment. The interaction between the image of the user and the display virtual objects is also displayed, in addition to an indication of the interaction such as a visual and/or an audio feedback.