A holding device such as a paper napkin or paper towel holder for manual dispensing paper sheets while restraining a stack of napkins or a roll of towels rotating about a vertical axis and for restraining the roll from moving or unwinding when at rest. The restraint arm has a proximal end pivotally mounted to the base and a distal end engaging the outer layer of the stack or roll. Preferably, the distal end of the arm engages a middle portion of the outer layer of the roll and includes a curved contact pad.