US Patent 10055898 Multi-video registration for video synthesis

Multi-video registration for video synthesis is described. In example implementations, at least one computing device synthesizes multiple videos to create merged images using an automated mechanism to register the multiple videos. The computing device obtains multiple videos with each video including a sequence of multiple frames. Using multiple camera poses determined in a three-dimensional scene reconstruction, respective frames of respective ones of the multiple videos are linked to produce linked frames. The computing device aligns the linked frames to produce aligned frames using point guidance that is based on the multiple spatial points identified in the 3D scene reconstruction. For example, pixels in each of the linked frames that correspond to a same spatial point of the three-dimensional scene reconstruction can be used to align the linked frames at a pixel level. Based on the aligned frames, the computing device creates at least one merged image to synthesize the multiple videos.