A displacement detection device includes a light source, an image sensor and a processing unit. The light source is configured to illuminate a work surface. The image sensor is configured to capture reflected light from the work surface and to output an image frame. The processing unit is configured to select a window of interest in the image frame having a maximum image feature and to calculate a displacement of the displacement detection device according to the window of interest.