Simulation data of the autonomous vehicle is processed by executing a simulation based on the simulation data to generate a simulation result. Then a perception scenario is generated from the simulation result. The generated perception scenario is validated by verifying whether a constraint is satisfied to produce a validated perception scenario. The validated perception scenario can be used to create or refine a perception model used for controlling the operation of autonomous vehicles.