US Patent 12130602 Systems and techniques for validating a simulation framework

Systems and techniques are provided for validating a simulation framework. An example method includes performing a first plurality of simulations corresponding to a plurality of software versions, wherein the first plurality of simulations use a first simulation framework configured to test a simulation scenario; detecting, based on the first plurality of simulations, a first change in a simulation metric associated with the simulation scenario among a portion of the plurality of software versions; performing a second plurality of simulations corresponding to the portion of the plurality of software versions, wherein the second plurality of simulations use a second simulation framework configured to test the simulation scenario; determining, based on the second plurality of simulations, a second change in the simulation metric; and comparing the first change in the simulation metric with the second change in the simulation metric to determine a reliability metric corresponding to the second simulation framework.