A video signal processing apparatus comprising a motion vector detecting section detecting a video motion vector from current-field and pre-field video signals or video signal before and after one field of the current-field video signal, a first interpolation signal generating section displacing the pre-field video signal at a unit of block in accordance with the motion vector to generate a first interpolation signal, a second interpolation signal generating section adding the current-field video signal to a vertical high-band component of the first interpolation to generate a second interpolation signal, a comparison reference signal generating section generating a comparison reference signal from the current-field video signal, and an output control section controlling the output of first and second interpolation signals based on a correlation between first and second interpolation signals and the comparison reference signal.