A hand shake blur signal reduction means for reducing the hand shake blur signal using given reduction ratio in the horizontal direction and reduction ratio in the vertical direction; an image restoration filter generating means for generating the image restoration filter based on the hand shake blur signal reduced by the hand shake blur signal reduction means; an image reduction means for reducing the hand shake blur image at the reduction ratio same as the reduction ratios in the horizontal direction and the vertical direction used in reducing the hand shake blur signal in the hand shake blur signal reduction means; an image restoration means for performing image restoration on the hand shake blur image reduced by the image reduction means using the image restoration filter generated by the image restoration filter generating means; and an image enlargement means for generating the restored image for the hand shake blur image by enlarging the restored image restored by the image restoration means are arranged.