Provided is a mouse interface apparatus using a camera, and system and method using the mouse interface apparatus. The mouse interface apparatus detects image coordinates (xi, yi) of a plurality of points existing on edges of a camera-photographing computer window image from the camera-photographing computer window image, obtains a homography using the detected image coordinates (xi, yi) and plane coordinates (Xi, Yi) of the plurality of preset points on a plane of a real computer window, the homography converting the detected image coordinates (xi, yi) into the plane coordinates (Xi, Yi) on the real computer window, converts an arbitrary coordinate on the camera-photographing image into the plane coordinate on the computer window according to a movement of the camera using the obtained homography, and positions a cursor on the plane coordinate to move the position of the cursor according to the movement of the camera.