A moving image generating apparatus for generating three-dimensional moving image to display a subject as a three-dimensional object, comprises a plurality of two-dimensional moving image generators, and each of the two-dimensional moving image generators is provided to each position, of which relative positions with respect to each of the two-dimensional moving image generators is predetermined respectively, and captures the subject at different timing intermittently, so that each of the two-dimensional moving image generators generating two-dimensional captured moving image respectively, and a three-dimensional moving image generator operable to generate the three-dimensional moving image of which frame rate is higher than a frame rate of the two-dimensional captured moving image, based on both the relative positions of the plurality of two-dimensional moving image generator and the two-dimensional captured moving images generated by the two-dimensional moving image generators.