Methods and systems for grouping video frames. The video frames may be from a multiplexed stream of video frames from a plurality of video sources. In some embodiments video frames are grouped by determining if the video frames share meaningful modes for values representative of features of the video frames.