An object of the present invention is to make it possible to adjust the amount of motion blur contained in a blurred image. A unit-of-processing determining portion 901 determines the unit of processing which is formed of pixel data located on a straight line. An equation generator 903 generates simultaneous equations consisting of a plurality of relational expressions based on the unit of processing. A calculator 904 generates foreground object components in which the amount of motion blur is adjusted by solving the simultaneous equations. The present invention can be applied to an image processing apparatus in which a difference between a signal detected by a sensor and the real world is taken into consideration.