A method of detecting image quality defects in the output of an image output device includes the steps of generating a test pattern at a known time, analyzing the test pattern to generate image quality defect records, storing the image quality defect records in memory linked to a time stamp indicating known time when the test pattern was generated, repeating the generating, analyzing and storing steps at a plurality of different known times to generate a database of time stamped image quality defect records, reconstructing isolated defect data from each of a plurality of image quality defect records in the database, constructing cumulative defect data by probabilistic summation of the isolated defect data and analyzing the cumulative defect data using an image quality assessment/analysis engine.