A vehicle control system includes: a vehicle control unit that remotely controls a PW, which is a control object, based on a signal from a mobile device; a mobile-side stop processing unit that performs stop process for stopping the PW upon transition to a predetermined operation state in which user operations are restricted while the PW is in operation by the remote control.