A system for determining a hitch angle between a vehicle and a trailer is provided herein. An imaging device is configured to capture images of the trailer. A controller is configured to process image data to determine an optical flow. The controller distinguishes between optical flow vectors of pixels associated with the trailer and an operating environment. The controller calculates an average angular velocity for the pixels associated with the trailer and determines the hitch angle based on the average angular velocity.