The invention discloses a method and a device for estimating a vanishing point from an image, a computer program and memory medium thereof. One of the methods for estimating the vanishing point from the image of the invention includes: a dividing step for dividing the image into snippets; a first detecting step for detecting a local direction of each snippet; a combining step for combining lines of directional pencil of lines according to the local direction detected in the first detecting step; and a first calculating step for calculating at least one vanishing point according to the combined lines of directional pencil of lines in the combining step. Based on the vanishing point received from the invention, the file image can be accurately and quickly executed with perspective and correction.