Techniques for recovering reflectance and illumination from natural image sequences, which techniques can be implemented separately, or combined. The images in a sequence of images can be aligned. The images can also be transformed into the log opponent color domain to increase filter sparseness and reduce chrominance errors. Additionally, a collection of filters spanning frequency space can be employed that reduce low frequency artifacts.