Offline task-based feature processing for aerial vehicles is provided. A system can extract features from a world model generated using sensor information captured by sensors mounted on an aerial vehicle. The system generates a label for each of the features and identifies identify processing levels based on the features. The system selects a processing level for each feature of a subset of features based on a task performed by the aerial vehicle and the label associated with the feature. The system generates one or more processed features by applying the processing level to a respective feature of the subset of the plurality of features. The system presents the one or more processed features on a display device of the aerial vehicle.