An image vibration-compensating apparatus and a method thereof are provided. The apparatus and the method are applied in an image-capturing apparatus, such as a digital still camera (DSC) or digital video recorder (DVR), for compensating image vibration when capturing an image. The image vibration-compensating apparatus comprises an adaptive edge extractor, a sub-region movement detector, a frame motion calculator, and a correcting vector generator. The image vibration-compensating apparatus analyses the difference between the current image and the previous image, and outputs the correcting motion vector to achieve the function of image vibration-compensation. In the image vibration-compensating method, an accumulate compensation mode is used to prevent fast motion of an image frame which will cause discomfort of the user's eyes when a relatively large image vibration occurs in a short period.