An interactive server, a control method thereof, and an interactive system are provided. The interactive server includes: a communicator which communicates with a display apparatus to receive an uttered voice signal; a storage device which stores utterance history information of a second uttered voice signal received from the display apparatus before the first uttered voice signal is received; an extractor which extracts uttered elements from the received first uttered voice signal; and a controller which generates response information based on the utterance history information stored in the storage device and the extracted uttered elements and transmits the response information to the display apparatus. Therefore, the interactive server comprehends intentions of the user with respect to various uttered voices of the user to generate response information according to the intentions and transmits the response information to the display apparatus.