Provided is an apparatus and method for processing a scene that may prevent overload of a scene caused by transmission of excessive information, by generating geometric information corresponding to meaningful information, as which sensed information may be construed semantically, and by only transmitting the geometric information to the scene, instead of transmitting, to the scene, all of the sensed information with respect to a real world.