In a cryptographic key distribution system by the phase modulation using a single photon state or a faint LD light, there is required an interferometer independent on polarization and stabilized against thermal fluctuations in order to make a transmission distance longer. Cryptographic key distribution systems are generally low in cryptographic-key-generating efficiency, and an improvement in the efficiency is demanded. In the present invention, two interferometers are disposed within the receiver so as to require no phase modulator within the receiver, thereby achieving a polarization-independent receiver. The pulses are paired, and the signal is transmitted with the relative phase, and the interval of the paired pulses is sufficiently reduced to set the optical path within the interferometer in the receiver to be smaller, thereby achieving the interferometer stabilized against thermal fluctuations. The transmission rate is set sufficiently larger than the average detection rate, and only a part of the transmitted random numbers is detected at random. This reduces a probability that an eavesdropper and a regular recipient observe data at the same slot.