A camera apparatus capable of tracking a target object based on motion of a camera sensed by a motion sensor and a method for tracking an object in the camera apparatus are provided. The method includes, if input image data is inputted, sensing motion of a camera which captures the input image data, generating camera motion data corresponding to motion of the camera, estimating a pose or motion of the camera based on the camera motion data, and tracking translation of a target object based on at least one of the estimated pose or motion of the camera and the input image data.