US Patent 11447142 Assessing surprise for autonomous vehicles

Aspects of the disclosure provide for controlling an autonomous vehicle. For instance, a first probability distribution may be generated for the vehicle at a first future point in time using a generative model for predicting expected behaviors of objects and a set of characteristics for the vehicle at an initial time expected to be perceived by an observer. Planning system software of the vehicle may be used to generate a trajectory for the vehicle to follow. A second probability distribution may be generated for a second future point in time using the generative model based on the trajectory and a set of characteristics for the vehicle at the first future point expected to be perceived by the observer. A surprise assessment may be generated by comparing the first probability distribution to the second probability distribution. The vehicle may be controlled based on the surprise assessment.