An improved device for controlling, either directly or indirectly, the injection of pressurized fuel into an internal combustion engine. The device comprises a body having a fuel inlet, a fuel outlet and a fuel return, as well as a valve mounted therein. The valve is actuated by an electromagnet and is adapted to establish communication between the fuel inlet and the fuel outlet when the valve is actuated. The device has a fuel accumulator comprising an opening in one side of the body and a diaphragm mounted across the opening to form an enclosed volume within the body. The enclosed volume communicates with the fuel input so that the diaphragm deflects outwardly with respect to the interior of the body in response to increases in the pressure of the pressurized fuel provided to the fuel input. The improvement comprises a pressure regulator having a regulatory valve disposed within the body and actuated by the diaphragm. The regulatory valve has an input in communication with the enclosed volume and an output in communication with the fuel return. The regulatory valve is adapted to establish communication between the enclosed volume and the fuel return when the pressure of the pressurized fuel in the enclosed volume reaches a predetermined value.