The present invention relates to a system and method for multimedia packet processing and, in particular, to a system and method for processing video or audio data in real time or near real time. The transmission of ordinary data packets that can tolerate a certain amount of delay is deferred so that video or audio packets can be transmitted ahead of ordinary data packets. The deferred data packets are stored in the second buffer module of the dual buffer module. After all of the video packets or audio packets are transmitted, the deferred data packets are transmitted prior to the transmission of other waiting data packets stored according to a related art back-off process.