A remote maintenance server includes a processor that operates as a remote panel function start instruction receiving unit that receives an instruction to start a remote panel function from a user via the user terminal and the user operation server, a relay server determining unit that determines the relay server to be used when executing the remote panel function, a verification information writing unit that writes verification information in the cache server, the verification information being used when the relay server relays connection, and a connection command sending unit that sends a connection command to the image forming apparatus that executes the remote panel function via the connection server, the connection command instructing to connect to the relay server to be used.