A method and system for categorizing non-textual subject data, such as digital images, content-based data and meta-data to determine outcomes of classification tasks. The meta-data is indicative of the operational conditions of a recording device during the capturing of the content-based data. For example, the non-textual subject data may be a digital image captured by a digital camera, and the meta-data may include automatic gain setting, film speed, shutter speed, aperture/lens index, focusing distance, date and time, and flash/no flash operation. The subject image is tagged with selected classifiers by subjecting the image to a series of classification tasks utilizing both content-based data and meta data to determine classifiers associated with the subject image.