A method and apparatus for pre-processing an image sequence to extract side information concerning the image sequence. In one embodiment, the side information is inserted into the image sequence, such that upon being encoded at a later time, the encoder can utilize the side information to best select one or more coding parameters. Alternatively, the side information can be stored on a storage device and is then made available to an encoder that is tasked with encoding the image sequence.