A method and apparatus for detecting and locating objects of interest in video sequences is provided. A frame is defined as an image belonging to video sequences. Each frame with the same or different size of original input sequences is searched by the same or different size window efficiently for detecting objects. The characteristics of temporal redundancies in video sequences are used in detecting objects in video sequences.