A vehicle control system which is capable of performing a quick decelerating operation in all vehicle speed regions and setting a direct region where power from an engine is transmitted through a mechanical transmission unit only in a hydro-mechanical transmission. The vehicle control system includes an engine and a hydro-mechanical transmission and is designed to set a tractive force-vehicle speed characteristic corresponding to the direct region where power transmission from the input shaft to the intermediate output shaft of the hydro-mechanical transmission is done by the mechanical transmission unit alone in a specified engine speed region. An engine control system controls the engine and a decelerator outputs a deceleration command according to an operating amount thereof. The engine control system controls the engine to reduce engine output torque corresponding to a specified engine speed region in response to the deceleration command.