A cosmetic composition for treating acne includes at least one acne treatment active that includes at least one beta hydroxy acid and an aqueous carrier comprising at least one cationic polymer. In some embodiments the cosmetic composition is a cleanser that comprises at least one surfactant. When the composition is applied to a keratinous tissue it demonstrates deposition and retention of the beta hydroxy acid on the keratinous tissue after rinsing with water in an amount representing about at least 60% and up to about 250% greater as compared with an amount deposited using a composition that lacks the at least one cationic polymer.