A fuel pressure relief valve includes a body defining a passageway having an inlet end in communication with a fuel pump and an outlet end in communication with a fuel rail. The valve also includes a seal member moveable between a first position in which the seal member is seated against the outlet end, and a second position in which the seal member is unseated from the outlet end. The valve further includes a biasing member biasing the seal member toward the second position. The seal member moves from the second position to the first position immediately after fuel pump shutoff to maintain pressure in the fuel rail. The seal member moves from the first position to the second position when fuel in the fuel rail drops to a residual pressure substantially less than the operating pressure to provide a leak path between the fuel pump and the fuel rail.