Provided are techniques for using containers to store objects. One data store from a set of data stores is assigned as a primary data store, wherein the remaining data stores comprise secondary data stores. A container for a group is created on the primary data store. A unique identifier for the container is generated on the primary data store. Metadata for the container is stored on the primary data store. Zero or more objects are stored in the container on the primary data store. For each of the secondary data stores that have objects belonging to the group, a container is created in that secondary data store having the unique identifier, wherein the container spans the primary data store and the secondary data stores, and wherein the objects in the container do not span the primary data store and the secondary data stores.