US Patent 9462293 Super resolution weighting blending

A method of receiving video data receives an original image at a processing device, estimates an image of higher resolution than the original image from the original image, generate a simulated image of the original image from the higher resolution image, derives difference data between the original image and the simulated image, upscale the difference data, wherein upscaling includes weighting the difference data with an adjusted confidence value, wherein the confidence value is adjusted based upon local information, and uses the upscaled difference data to estimate a new higher resolution image.