There is provided a hologram reconstruction method including: onto an optical recording medium in which a hologram is recorded by simultaneously irradiating the Fourier transformed signal beam representing a digital data with a bright and dark image and removing a DC component and the Fourier transformed reference beam thereon, irradiating a first reference beam for reading out that is the same as the reference beam to generate a first diffracted light generated by the recorded hologram, and synthesizing a DC component of a predetermined phase with the generated first diffracted light to generate a first synthesized light; detecting an inverse Fourier transformed image of the first synthesized light to obtain first image data; irradiating a second reference beam for reading out that differs from the reference beam onto the hologram recorded on the optical recording medium to generate a second diffracted light from the recorded hologram, and synthesizing a DC component of a predetermined phase with the generated second diffracted light to generate a second synthesized light; detecting an inverse Fourier transformed image of the second synthesized light to obtain second image data; subtracting one of the first image data and the second image data from the other at each pixel of the light and dark image; and decoding the digital data based on the value obtained by subtraction.