The device of this invention has a variable capacity pump, a channel through which the discharged fluid from the pump passes toward an actuator, a variable choke located in the channel and pressure detecting means which detects the pressure difference on opposite sides of the variable choke. The pump varies its volume in relation with the pressure difference detected by the pressure detecting means. The opening area of the channel is varied by the variable choke in relation with the pressure of the fluid being supplied to the actuator, namely the pressure of the fluid flowing downstream of the variable choke. The device of this invention may also have an auxiliary variable choke located in the channel. The auxiliary variable choke can control the amount of fluid being supplied to the actuator in response to the operating condition of the actuator.