A method for remotely assessing oral health of a user of a mobile device by obtaining, using the mobile device (40), at least one digital image (1) of said user's (30) oral cavity (31) and additional non-image data (2) comprising anamnestic information about the user (30). The digital image (1) is processed both using a statistical object detection algorithm (20) to extract at least one local visual feature (3) corresponding to a medical finding related to a sub-region of said user's oral cavity (31); and also using a statistical image recognition algorithm (21) to extract at least one global classification label (4) corresponding to a medical finding related to said user's oral cavity (31) as a whole. An assessment (10) of the oral health of said user (30) is determined based on the local visual feature(s) (3), the global classification label(s) (4) and the non-image data (2).