A container for use with a handheld fluid dispenser is provided. The container may include a container body having interconnected walls that define an inside space therebetween and in which liquid contents are held. An opening may extend through the container body and permit access to the liquid contents in the container body. A cap may engage the container body and be aligned with the opening of the container body. The cap may include a rim that defines an outer portion of the cap. A neck may be arranged concentrically within the rim, the neck including a bore that extends longitudinally through the neck and is aligned with the opening of the container body. A recess that has an annular shape may be defined between the rim and the neck of the cap.