A method for deep learning video microscopy-based antimicrobial susceptibility testing of a bacterial strain in a sample by acquiring image sequences of individual bacterial cells of the bacterial strain in a subject sample before, during, and after exposure to each antibiotic at different concentrations. The image sequences are compressed into static images while preserving essential phenotypic features. Data representing the static images are input into a pre-trained deep learning (DL) model which generates output data; and antimicrobial susceptibility for the bacterial strain is determined from the output data.