US Patent 12017686 Assessing surprise for autonomous vehicles

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for computing a backward looking surprise metric for autonomously driven vehicles. One of the methods includes obtaining first data representing one or more previously predicted states of an agent along one or more predicted trajectories of the agent at a first time step. Second data representing one or more states of the agent at a subsequent time step is obtained. A surprise score is computed from a measure of a difference between the first data computed for the one or more predicted trajectories for the prior time step and the second data computed for the one or more predicted states for the subsequent time step.