A video signal processing apparatus, for achieving high resolution of a video signal, in particular, the video signal of moving pictures, preferably, comprises a motion estimation portion (101) for estimating a sampling phase difference with using video data on an input video frame as a reference and each video data on other input video frame, a motion compensation/up-rate portion (115) for compensating motion of the video data of the each input video frame with using information of said sampling phase difference, as well as, to increase the number of pixels to n times, a phase shift portion (116) for shifting the video data of each of the video frames, the pixel number of which is increased, by a predetermined amount, a coefficient determining portion, which is configured to determine a coefficient with using information of said sampling phase difference; and an aliasing component removal portion (117) for removing (n−1) pieces of aliasing components, by adding each of video data in front and back of said phase shifting after multiplying them by said coefficient, thereby to provide an output.