This invention provides a composition and a means being capable of easily recovering the color of faded clothes in home. The composition is a color recovering agent which comprises (a) a water-insoluble polymer with a refractive index of 1.20 to 1.45 at 25°C, (b) a compound or polymer having a molecular weight of 300 to 1,000 having specific groups such as amide group, (c) water and (d) a non-aqueous solvent, wherein the ratio of (a)/(b) by weight is in the range of 3/1 to 100/1.