A system that receives a first video stream of a scene having a first viewpoint and a second video stream having a second viewpoint wherein camera calibration between the first viewpoint and the second viewpoint is unknown. A viewer selects a viewer viewpoint generally between the first viewpoint and the second viewpoint, and the system synthesizes the viewer viewpoint based upon the first video stream and the second video stream.