A position monitoring system for an agricultural system includes a controller having a memory and a processor. The controller is configured to receive a remote sensor signal from a remote sensor indicative of a state of a reference element on one of a work vehicle or an agricultural implement coupled to the work vehicle, determine an orientation of the agricultural implement relative to the work vehicle based at least in part on the remote sensor signal, and output a control signal to control operation of the agricultural system based at least in part on the orientation of the agricultural implement relative to the work vehicle.