A method of tracking an object and an electronic device supporting the same are provided. The method includes predicting a movement of a tracked object, comparing features of current image information based on predicted information with features of each of key frames, selecting a particular key frame from the key frames according to a result of the comparison, and estimating a pose by correcting the movement of the object in the current image information based on the selected key frame, wherein the comparing of the features comprises defining a location value of the feature by relation with neighboring features.