An optical image anti-shake device with a yoke is provided. The optical image anti-shake device includes: a casing having a first aperture; a fixing portion having a bottom plate, the bottom plate having a second aperture corresponding in position to the first aperture; and an active portion enclosed by the casing and resiliently clamped between the casing and the bottom plate by the fixing portion, the active portion including: a correcting module for correcting, with a magnetic force, a blur of images caused by a shake of the optical image anti-shake device; a frame having a receiving space; a lens holder disposed in the receiving space of the frame; a lens unit corresponding in position to the first aperture and the second aperture, the lens unit being carried by the lens holder and having an image-capturing optical axis; and a yoke fixed to the frame.