A vehicle management system can include self-driving vehicles. Before entering a self-driving vehicle, a rider can use a remote computing device to select a pick-up location at which a self-driving vehicle will later pick up the rider. Detecting that the remote computing device is unable to communicate with the vehicle management system can trigger several responses configured to minimize the risk of a self-driving vehicle failing to pick up the rider.