A container for use with a handheld fluid dispenser is provided. The container may include a front wall facing a first direction, a back wall facing in a second, opposite, direction, and at least one side wall interconnecting the front and back walls. A lower wall may be arranged above a lower portion of a handheld fluid dispenser in which the container is mounted. An upper wall may be arranged below an upper portion of the handheld fluid dispenser. The upper wall may interconnect the front wall, back wall, and at least one side wall of the container. An opening extends through the upper wall and permitting access to contents that are held in the container. The opening extends through the upper wall at a location that is nearer the back wall than the front wall of the container.