A tracking apparatus and method in which the possible position of a current face is estimated based on the face positions previously determined as well as plural pieces of ambient information corresponding to the possible positions obtained. The current face position is estimated based on the position of the ambient information that is most similar to the ambient information obtained from previous detections.