According to one aspect of the present invention, there is provided a radio communication device that performs communication with a terminal-side communication device having an antenna using an analog signal for transmitting information by a waveform of an amplitude or a phase of light to receive a signal received by the antenna and transmit a signal radiated by the antenna, the terminal-side communication device and the radio communication device being included in a radio communication system that performs radio communication with a communication target terminal via the antenna using time division duplex (TDD), the radio communication device including: an uplink delay adjustment unit configured to adjust a delay caused by propagation of an uplink signal that is a signal flowing from the terminal to the radio communication device via the antenna; and a downlink delay adjustment unit configured to adjust a delay caused by propagation of a downlink signal that is a signal flowing from the radio communication device to the terminal via the antenna.