Provided are a system and method for displaying a virtual image through a head mounted display (HMD) device. A method by which a device displays a virtual image through an HMD device includes: receiving, from the HMD device, an object image of a real space captured through a camera included in the HMD device; determining a virtual image to be displayed at a particular position around the captured object; determining an operation of the virtual image corresponding to the object and the particular position; and providing the virtual image and operation information about the determined operation to the HMD device, wherein the provided virtual image is displayed through the HMD device.