Object detection using a transformer-based object detection model includes randomly initializing basic queries for the model, modulating the basic queries based on semantics of input images, and training the model basic on features extracted from input images and the modulated queries.