A system and method for controlling animated characters. The system involves an animated character mapping perception into a number of domains, including a world domain, linguistic domain and social domain. The system is computationally perceived items that should be abstracted from the character's environment for processing. The animated character is able to utilize different levels of information gathering or learning, different levels of decision making, and different levels of dynamic responses to provide life-like interactions.