A system and method is disclosed for automatically determining position information for an invasive medical device based on imaging data. An imaging device can generate 2D images of the invasive medical device within the patient from a vantage point relative to the patient. A trained model for the invasive medical device can be trained on annotated 2D images of the invasive medical device with position information. An imaging computer system can apply the trained model to unannotated 2D images of the invasive medical device within the patient to determine a current position of the invasive medical device. The 2D images of the invasive medical device and visual position information representing the current position of the invasive medical device can be outputted to a display.