Example techniques are disclosed for performing optical recognition of fish. For example, image features can be extracted from an image of a fish and used in conjunction with location or time information to determine a species of the fish. The classification can be performed with one or more trained classifiers that are trained using training images of fish having labels indicating species of the fish.