An apparatus, method, and medium for implementing a pointing user interface using light emitters are disclosed. The pointing device includes a light-noise removing unit which receives signals emitted from a plurality of light emitters included in a display device in predetermined manners, a light emitter position detecting unit which calculates position information of the received signals, a pointed-to position calculating unit which calculates pointed-to position information using the calculated position information, and a data transmitting unit which transmits the pointed-to position information to the display device.