A method for 3-D enhancement of video playback. The method includes receiving a plurality of video streams from a corresponding plurality of video capture devices and processing image data comprising each of the video streams using a 3-D surface reconstruction algorithm to create a 3-D surface map representative of the image data. The 3-D surface map is manipulated to create a virtual camera position. Video is then rendered in accordance with the 3-D surface map and in accordance with the virtual camera position.