Disclosed herein are non-aqueous dentifrice compositions comprising (i) a whitening complex comprising crosslinked polyvinylpyrrolidone complexed with hydrogen peroxide; (ii) an off-gas reducing agent selected from sodium sulfate, magnesium sulfate, citric acid and clay; and (iii) an orally acceptable carrier. Methods of making and using the compositions are also provided.