An apparatus for controlling a robot and a method thereof are provided. The apparatus includes: a state interpretation unit determining whether or not a current situation belongs to a preset unstable state by evaluating the current situation based on a plurality of perception information items; and a target generation unit setting a target action of the robot by comparing the current situation and the determination result with a predetermined value system, and then, modifying the target action by receiving a feedback of the action performance result of the robot as perception information. According to the method and apparatus, by inputting a processing procedure and a value system to solve a variety of unstable states that can occur in situations of a user and circumstances surrounding the robot, the robot can actively respond with actions.