A brush holding apparatus for a rotary electric machine permitting removal and replacement of brushes without stopping the rotation of the rotary electric machine comprises a brush holder which can be detached from a stationary unit, and a securing device for detachably securing the brush holder to the stationary unit. A manipulating lever is provided on the stationary unit to actuate the securing device. The brush holder can easily be mounted on or detached from the stationary unit by the manipulation of the manipulating lever for the puppose of removal and replacement of the brushes while the rotary electric machine is in operation.