A system and method for providing a method for reducing artifacts in a video sequence of image frames is disclosed. The method and system include classifying scenes in the sequence of image frames, analyzing the content of the image frames and performing temporal filtering on the image frames. The method and system further include applying a set of rules to results of the classification and the content analysis to adapt characteristics of the temporal filtering for the scene.