The present invention relates to leave on, oil-in-water, skin care compositions, comprising: (A) from about 0.05% to about 20% of an acidic active ingredient, preferably having a solubility parameter from about 6 to about 12; (B) from about 0.1% to about 25% of alkoxylated alcohols, alkoxylated polyols, and mixtures thereof; (C) from about 1% to about 20% of an acid stable, hydrophobic, structuring agent selected from the group consisting of saturated C.sub.16 to C.sub.30 fatty alcohols, saturated C.sub.16 to C.sub.30 fatty alcohols containing from about 1 to about 5 moles of ethylene oxide, saturated C.sub.16 to C.sub.30 diols, saturated C.sub.16 to C.sub.30 monoglycerol ethers, saturated C.sub.16 to C.sub.30 hydroxy fatty acids, and mixtures thereof, having a melting point of at least about 45.degree. C.; (D) from about 0.05% to about 10% of an acid stable, hydrophilic surfactant selected from the group consisting of anionic, cationic, zwitterionic, nonionic surfactant, and mixtures thereof; and (F) from about 25% to about 99.7% water; wherein the pH of the composition is about 3.5 or less. These cosmetic compositions provide improved physical and chemical stability, while providing good skin deposition and good skin penetration of the active ingredients, while also providing low dermal irritation.