A biopsy device comprises a probe body, a cannula extending distally from the probe body, a cutter moveable relative to the cannula to sever tissue, and a tissue sample holder coupled with the probe body. The tissue sample holder comprises a rotatable member and at least one removable member secured about the exterior of the rotatable member. The at least one removable member defines a plurality of tissue sample compartments. Each tissue sample compartment is configured to receive one or more tissue samples captured by the cutter. In some versions, the at least one removable member comprises a belt and a plurality of vials.