A sharp/blurred frame mode classifying unit specifies a frame to be subjected to sharp or blurred process. A 3D video signal extracting unit extracts a predetermined area or predetermined macro block in the specified target frame, and a 3D FFT 15 frequency-converts it to acquire a coefficient string. An intersection coordinate calculating unit finds a non-perceptible high frequency coefficient based on a spatio-temporal visual property model for the coefficient string, and a coefficient cut processing unit cuts the non-perceptible high frequency coefficient for a frequency conversion coefficient of orthogonal conversion of a predictive error signal. The code amount of a video signal is largely reduced for a high frame rate video by the processings only at the encode side without deteriorating the picture quality.