A jiggle measuring system and a jiggle measuring method are provided for making it possible to detect a time sequential change of jiggles of a camera and, in particular, jiggles about three axes of the camera without setting an additional device at the camera. The jiggle measuring system and the jiggle measuring device sequentially display a plurality of different kinds of test patterns (P1-Pn); carry out a pattern recognition of an image that is consistent with a template corresponding to each test pattern from a synthesized image (d) comprised of not less than two test patterns from these patterns (P1-Pn), wherein their still images are picked up by a camera (2); and treat a moving direction and a moving amount of each template at the pattern recognition as a jiggle direction and a jiggle amount of the camera (2).