A video signal processing apparatus in which an input video signal is written in a frame memory on a line sequential scanning frame unit base in synchronism with a first vertical synchronizing signal and which the line sequential scanning video signal written in the frame memory is read out in synchronism with a second vertical synchronizing signal. The second vertical synchronizing signal having a frequency different from a frequency of a first vertical synchronizing signal is generated in synchronism with the first vertical synchronizing signal of a starting frame of five frames forming a pattern after the conversion in the 2-3 pulldown conversion system when it is judged that the input video signal is based on a telecine-converted video signal.