This invention presented a universal de-interlacing method and system by the motion detection, the motion adaptive interpolation, the directional edge interpolation, the 3:2 pull-downed detection and the 3:2 Pull-Downed recovery. Four-field motion detection can detect the motion area and the still area. By cooperating with the motion adaptive interpolation and the directional edge interpolation the picture possesses the very clear quality, high contrast, and high resolution. The 3:2 pull-downed detection and the 3:2 Pull-Downed recovery can detect the 3:2 Pull-Downed movie sequence and recover the interlaced fields into a progressive frames universally without too much overhead of computational power.