A method and system for detecting and tracking multiple catheters in a fluoroscopic image sequence in an integrated central processing unit and graphics processing unit framework is disclosed. A catheter electrode model is initialized in a first frame of the fluoroscopic image sequence. The catheter landmark candidates are detected, by a graphics processing unit, in the first frame of the fluoroscopic image sequence. The catheter electrode model is tracked, by a central processing unit, and is detected by the graphics processing unit, in subsequent frames of the fluoroscopic image sequence by detecting catheter landmark candidates in the subsequent frames of the fluoroscopic image sequence using at least one trained catheter landmark detector, and outputting the catheter model tracking and landmark detection results of for each frame of the fluoroscopic image sequence.