A method and system for segmenting multiple organs in medical image data is disclosed. A plurality of landmarks of a plurality of organs are detected in a medical image using an integrated local and global context detector. A global posterior integrates evidence of a plurality of image patches to generate location predictions for the landmarks. For each landmark, a trained discriminative classifier for that landmark evaluates the location predictions for that landmark based on local context. A segmentation of each of the plurality of organs is then generated based on the detected landmarks.