An image data recording apparatus includes a three-dimensional display control information generation unit receiving a parameter indicating a condition for picking up a three-dimensional image, and encoding the parameter so as to generate image pick-up condition information, and a file generation unit generating a multimedia information file including both of the image pick-up condition information and three-dimensional image data or at least one of the three-dimensional image data and two-dimensional image data.