The invention discloses an expansion packer rubber cylinder capable of being quickly retracted. The expansion packer rubber cylinder comprises a rubber cylinder body, and further comprises a bracket assembly and bracket return driving mechanisms; the upper end of the rubber cylinder body is connected with an vulcanized upper joint, and the lower end of the rubber cylinder body is connected with avulcanized lower joint; the bracket return driving mechanisms comprise the upper bracket return driving mechanism and the lower bracket return driving mechanism; the bracket assembly comprises three or more brackets which are arranged in the rubber cylinder body at even angles; the brackets comprise skeleton plates, base rods and oblique rods; and the skeleton plates are inlaid in the rubber cylinder body in a vulcanized mode, the oblique rods are located in an inner cavity of the rubber cylinder body and each comprise an upper oblique section and a lower oblique section which are symmetrical,and the middles of the oblique rods are connected with the skeleton plates through the base rods. The rubber cylinder body rebounds and recovers under recovery force of the rubber cylinder body, meanwhile, pistons in closed cavities are pushed under the effects of the pressure in the cavities and springs, thus retraction of the rubber cylinder body is assisted and accelerated, the unsetting capability of a packer is improved, the rubber cylinder body is protected, and the reuse reliability of the rubber cylinder body is improved.