A system for controlling engine speed for a vehicle such as a fork-lift. The system has an accelerator pedal for controlling an engine speed, and a control lever for controlling the direction of movement of the vehicle, or the system is provided with a seesaw type accelerator pedal for controlling the engine speed and the direction of movement of the vehicle.An EXNOR gate is provided for detecting deceleration of the engine while the accelerator pedal is depressed. When deceleration is detected, the throttle valve is returned to an engine idling position or the supply of fuel is cut. Thus, an effective engine braking can be obtained when the direction of movement of the vehicle is changed while the accelerator pedal is depressed.A window comparator is provided for detecting the area near the end of deceleration, so that the engine speed is increased prior to the commencement of acceleration.