A shuffling table memory has a shuffling table written from an external memory through a path. The external memory stores a plurality of shuffling tables corresponding to the formats of video data to be shuffled. One shuffling table selected according to the result of format determination is stored in the shuffling table memory. The shuffling table memory receives an IDi separated from the input data as an address and outputs a converted address IDo. The address IDo generated by the shuffling table memory is used as a write address for writing data into a data-accumulation memory. With the read address sequentially changing, shuffled data is read from the data accumulation memory.