Various embodiments of the present technology relate to using neural networks to detect objects in images. More specifically, some embodiments relate to the reduction of computational analysis regarding object detection via neural networks. In an embodiment, a method of performing object detection is provided. The method comprises determining, via a convolution neural network, at least a classification of an image, wherein the classification corresponds to an object in the image and comprises location vectors corresponding to pixels of the image. The method also comprises, for at least a location vector of the location vectors, obtaining a confidence level, wherein the confidence level represents a probability of the object being present at the location vector, and calculating an upper-bound score based at least on the confidence level. The method further comprises, for at least an upper-bound score based at least on the confidence level, performing an activation function on the upper-bound score, and classifying, via a detection layer, the object in the image.