Determining undesirable, or "spam" communication, by reviewing and recognizing portions within the communications that are things other than ASCII or text. Images are analyzed to determine whether the content of the images is likely to represent undesired content. The images can be classified as to type, can be OCRed, and the contents of the recognition used for analysis, and can be compared against similar images in a database.