A gesture recognition system includes an EDOF lens, an image sensor, and a processing unit. The image sensor successively captures image frames through the EDOF lens. The processing unit is configured to perform gesture recognition according to at least one object image within a sharpness range in the image frames thereby eliminating the interference from background objects.