The input device and the input system include a hand detection means which detects the position of the hand, a body part detection means which detects positions of user's body parts such as the face, for example, a relative position calculation means which calculates a relative position of the hand with respect to body parts from hand position information being a detection result of the hand detection means and body part position information being a detection result of the body part detection means, and a gesture recognition means which recognizes a hand gesture on the basis of a change in the hand position information being the detection result of the hand detection means, wherein when a hand gesture is recognized, the operation of the input device with respect to the user's gesture is changed according to a relative position of the hand with respect to body parts.