A variety of methods and arrangements for reducing noise, vibration and harshness (NVH) in a skip fire engine control system are described. In one aspect, a firing sequence is used to operate the engine in a skip fire manner. A smoothing torque is determined that is applied to a powertrain by an energy storage/release device. The smoothing torque is arranged to at least partially cancel out variation in torque generated by the skip fire firing sequence. Various methods, powertrain controllers, arrangements and computer software related to the above operations are also described.