An image processing device and method, and a program, obtains processing results which are even more accurate and even more precise as to events in the real world, taking into consideration the real world where data has been acquired. In the event that the light signal in the actual world represented with a light signal function has predetermined continuity, the actual world estimating unit estimates the light signal function by approximating the light signal function with a predetermined approximation function using weighting provided in accordance with importance to the pixels within an input image (image data including continuity of data corresponding to continuity) from the sensor, and data continuity information (data continuity information corresponding to continuity of the input image data) from the data continuity detecting unit.