US Patent 10311547 Image upscaling system, training method thereof, and image upscaling method

An image upscaling system includes at least two convolutional neural network modules and at least one synthesizer. The convolutional neural network module and the synthesizer are alternately connected to one another. The first convolutional neural network module receive an input image and the corresponding supplemental image, generate a first number of the feature images, and output them to the next synthesizer connected thereto. Other convolutional neural network modules each may receive the output image from the previous synthesizer and the corresponding supplemental image, generate a second number of feature images, and output them to the next synthesizer connected thereto, or output them from the image upscaling system. The synthesizer may synthesize every n*n feature images in the received feature image into one feature image and output the resultant third number of feature images to the next convolutional neural network module connected thereto or output them from the image upscaling system.