Systems and methods described herein provide one or more processors configured to execute program instructions to cause the one or more processors to receive camera images of a scene including a portion being lit by the searchlight, receive terrain data from a terrain database, generate an augmented/virtual reality scene based on the camera images and the terrain data, display, via a headset display, the augmented/virtual reality scene, track gaze and head movement using headset sensors, output tracking data based on tracked gaze and head movement, and output instructions for controlling at least one function of the searchlight based on the tracking data.