The invention discloses a system and a method for gesture recognition of vehicle. The system for recognizing a user's gesture for carrying out an operation of a vehicle may include a camera installed within the vehicle to generate an object image, and a gesture recognizer that detects a user's hand from the object image, sets a region of interest (ROI) with reference to the user's hand, and recognizes the user's gesture by tracking the user's hand only within the ROI, where the ROI is varied depending on a moving direction and a moving speed of the user's hand.