An information processing apparatus permits a device which has set secret information into the information processing apparatus to refer to the secret information and inhibits other devices than the device from referring to the secret information, to thereby prevent secret information from leaking via any of the other devices. A determination is made whether there is a match between a device ID acquired from a device connected to an expansion card and stored in the expansion card and a device ID acquired in response to a request for reference to the secret information from a device to which the expansion card is currently connected. Reference to be made by the device to the secret information stored in the expansion card is permitted or inhibited according to a result of the determination.