A multi-point visual communication system which includes an adaptive filter part for controlling a spatial frequency characteristic of a video signal, a filter selector for selecting a video quality to be transmitted from its own site on the basis of integrated requests received from sites, and a filter control for adaptively controlling a filter characteristic taking both of a video information quantity and situations of a telecommunication network into consideration, and wherein a video signal processed by the adaptive filter part is subjected to an encoding operation and then transmitted to the telecommunication network. Thereby, the video quality can be selected according to users' requests, and the video quality of the multi-point visual communication can be improved without incurring an excessive increase of a video information quantity. Further, through the video signal processing taking both the video characteristic and the telecommunication network situations into consideration, a comparatively high quality of video transmission can be realized when viewed from an information quantity.