A system for guiding capsule medical device includes a capsule medical device that includes a capsule casing including an imaging unit and a permanent magnet magnetized in a direction relatively fixed with respect to an upward and downward direction of an imaging surface of the imaging unit. The capsule medical device has a center of gravity deviated from a geometric center of the casing toward a direction different from a magnetization direction of the permanent magnetic. In the capsule medical device, a plane parallel to the imaging surface and a plane parallel to the magnetization direction and a deviation direction of the center of gravity with respect to the geometric center form an intersection line. The system further includes a magnetic guidance device; and an image display device displaying an in-vivo image such that a direction of the intersection line conforms to an upward and downward direction of a screen.