Rinse-added fabric softening compositions are provided comprising mixtures of a diester quaternary ammonium fabric softener material, a highly ethoxylated hydrophobic material as a scum dispersant, and a liquid carrier. This mixture prevents the formation of scum caused by the interaction of the diester quaternary ammonium fabric softener material with anionic detergent surfactant and/or detergency builder entrapped in the fabric. These, preferably biodegradable, compositions have good product stability, dispersibility, and concentratability, as well as excellent fabric softening characteristics.