Process-response statistical modeling of visual images can be used in determining similarity between visual images. Evaluation of the content of visual images--and, in particular, image similarity determinations--can be used in effecting a variety of interactions (e.g., searching, indexing, grouping, summarizing, annotating, keyframing) with a collection of visual images.