The present application provides a hand detection and tracking method and device. The method includes the following: performing hand detection in each frame of image; performing location tracking on a detected hand to obtain a tracking result when the hand is detected in a frame of image; and verifying whether the tracking result is valid, to track the hand in a next frame or perform localized hand detection in the current frame based on the tracking result. In the present application, a verification step is added during tracking, so that a tracking result can be corrected in real time, thereby ensuring quick and accurate hand detection.