A method for view classification includes providing a frame of an object of interest, detecting a region of interest within the object of interest for each of a plurality of detectors (e.g., binary classifiers), wherein each binary classifier corresponds to a different view, performing a global view classification using a multiview classifier for each view, outputting a classification for each view, fusing outputs of the multiview classifiers, and determining and outputting a classification of the frame based on a fused output of the multiview classifiers.