A method of real-time tracking of an object includes capturing a first and a second image of the object. The object is detected in the first image and movement of the object is tracked between the images. Tracking of the object includes obtaining an initial pose of the camera; projecting an image of a model object onto the second image; determining a gradient profile of the second image from an edge point of the model object along a first direction that is normal to the edge of the model object; computing a radius on the gradient profile; determining a rank order of the peaks of the gradient profile along the radius; comparing the rank order with a predetermined rank order to generate a feature candidate point; and reducing a distance along the first direction between the feature candidate point and the edge point on the edge of the model object.