An optical millimeter wave terahertz transfer system and transfer method are disclosed. The device comprises a local terminal, a transfer link, an access terminal, and a user terminal. By using the device in the transfer link, optical signals transferred forward and backward are extracted through optical couplers, and millimeter wave terahertz signals with a stable phase are obtained at any position in the transfer link through optical signal filtering, photovoltaic conversion, microwave filtering, frequency division and optical frequency shift processing. The device and method have the characteristics of high reliability, simple structure, and low implementation cost.