A storage unit which stores n pieces of data is formed by m memories (m.noteq.n). The n pieces of data are sorted into the memories such that the n pieces of data can be read in parallel no matter which read scan mode is selected among a plurality of read scan modes. With this structure, rearrangement of image data, or the like, is realized with low cost and high speed.