Methods for guiding a surgical procedure include accessing information relating to a surgical procedure, accessing at least one image of a surgical site captured by an endoscope during the surgical procedure, identifying a tool captured in the at least one image by a machine learning system, determining whether the tool should be changed based on comparing the information relating to the surgical procedure and the tool identified by the machine learning system, and providing an indication when the determining indicates that the tool should be changed.