Disclosed are computer-implemented methods, non-transitory computer-readable media, and systems for detecting identity document photograph replacement. One computer-implemented method includes receiving image data of a cropped photograph region of an identity document (ID), where the ID comprises a photograph, and where the cropped photograph region comprises at least the photograph. Using a multiclass classification model and as a predicted ID category, an ID category is predicted based on the image data of the cropped photograph region, where the predicted ID category corresponds to a predefined class of a set of predefined classes in the multiclass classification model. The predicted ID category is compared with an indicated category of the ID. In response to a calculated mismatch between the predicted ID category and the indicated category of the ID, a determination is made that the cropped photograph region includes a replaced photograph.