The present invention is directed to de-interlacing method and apparatus using remote interpolation. An up window and a down window are firstly determined. The closest pair of pixels of the up window and the down window along a direction of 90.degree., -45.degree., and 45.degree. is determined, which is then used to interpolate a new pixel. Subsequently, the up window and the down window are moved or stayed according to which pair is determined as being closest.