A method (400) is disclosed for estimating an affine relation between a first image and a second image. The first and second images each have at least 4 non-parallel lines therein. The method (400) starts by identifying (406) sets of intersection points of the lines appearing in each of the images. The method (400) then determines (412) whether a relation between intersection points exists. If the relation exists then the first and second images are affine related and the affine distortion may be inverted (418).