A system for detecting a hitch angle between a vehicle and a trailer is provided herein. An imaging device is configured to capture images of the trailer and a controller is configured to process the captured images. The controller derives an edge map and identifies trailer pixels therein. The controller defines a number of candidate lines in the edge map and determines the hitch angle based on an angle between a selected candidate line and a reference line.