System and method for detecting objects in geospatial images, 3D point clouds and Digital Surface Models (DSMs). Deep Convolution Neural Networks (DCNNs) are trained using positive and negative training examples. Using a rotation pattern match of only positive examples reduces the number of negative examples required. In DCNNs softmax probability is variant of rotation angles. When rotation angle is coincident with object orientation, softmax probability has maximum value. During training, positive examples are rotated so that their orientation angles are zero. During detection, test images are rotated through different angles. At each angle, softmax probability is computed. A final object detection is based on maximum softmax probability as well as a pattern match between softmax probability patterns of all positive examples and the softmax probability pattern of a target object at different rotation angles. The object orientation is determined at the rotation angle when softmax probability has maximum value.