A device for spraying an inner surface of a toilet bowl with a cleaning and/or deodorizing chemical is disclosed. The device can include a container for the chemical, a sprayer through which the chemical can be sprayed laterally at least halfway around a perimeter of the sprayer, means for attaching the sprayer near a rim of the toilet bowl, a fluid conduit in fluid communication with the container and the sprayer, and a manually operated pump for delivering chemical from the container through the fluid conduit and to the sprayer when the pump is operated. In one version, the pump includes a pump chamber in fluid communication with the container, a discharge conduit in fluid communication with the pump chamber and in fluid communication with the fluid conduit, and a piston that reciprocates in the pump chamber for drawing fluid from the container into the pump chamber and moving fluid from the pump chamber through the discharge conduit and into the fluid conduit. The device can apply chemical around the entire circumference of the inner surface of the toilet bowl.