US Patent 12008681 Systems and methods for testing vehicle systems

Systems and methods of testing a vehicle system. The systems and methods generate a simulation of a driving scenario to provide simulation video data, display the simulation on a monitor using the simulation video data, capture the displayed simulation using a camera system of the vehicle system to provide video data, process the video data using a perception algorithm to detect and track objects in the video data to provide perception data, control a vehicle actuator of the vehicle system in response to the perception data to provide command data, and adapt the simulation based on the command data. The camera system has a field of view and the monitor has a viewable area. The simulation of the driving scenario is scaled in proportion to a ratio of the field of view of the camera projected onto the monitor and dimensions of the viewable area.