Video image data is acquired from synchronized cameras having overlapping views of objects moving past the cameras through a scene image in a linear array and with a determined speed. Processing units generate one or more object detections associated with confidence scores within frames of the camera video stream data. The confidence scores are modified as a function of constraint contexts including a cross-frame constraint that is defined by other confidence scores of other object detection decisions from the video data that are acquired by the same camera at different times; a cross-view constraint defined by other confidence scores of other object detections in the video data from another camera with an overlapping field-of-view; and a cross-object constraint defined by a sequential context of a linear array of the objects, spatial attributes of the objects and the determined speed of the movement of the objects relative to the cameras.