A system for processing visual information and a method thereof. Exemplary embodiments provides to a terminal event information searched through space recognition by a processing server for long-term storing image information input through the terminal so as to match and output event information with the input image information and recognize events that are an object of interest in the input image information or the long-term stored the image information and provide the related information so as to learn interest characteristics of a user and store the interest characteristics in the database, thereby providing user-based information. In addition, the exemplary embodiments of the present invention long-term stores the visual information by processing the visual information through the processing server so as to be used as a black box and can be used for applications requiring various artificial intelligence functions such as a disabled sensory supporting system, a robot, or the like.