A system and method limit the scope of video analytics performed by a processor with limited processing power, such as an edge processor in communication with multiple imaging devices disposed within a monitored area. According to one embodiment, the processor accesses image data from each image capture device and performs non-operational video analytics to detect objects within the respective image data. The processor compares the detected objects in the respective image data over one or more time lapse periods. Based on results of the comparisons, the processor determines parameters for configuration files for the image capture devices, where each configuration file includes parameters for adjusting the respective image capture device to capture images of one or more particular areas of interest within the monitored area and/or disabling a transfer of image data from the respective image capture device. The processor communicates each configuration file to its respective image capture device.