A motorized window treatment may include a covering material, a motor drive unit, a headrail, a cover, and one or more mounting brackets. The cover may be configured to enclose at least an upper portion and a rear portion of the headrail. The mounting brackets may be configured to secure the motorized window treatment to a structure. The mounting brackets may include a biasing member that is configured to engage a lower lip of the cover to bias the respective mounting bracket toward the top plate of the cover. The mounting brackets may include a release button that is configured to extend through a gap between the headrail and the top plate of the cover. The release button may be configured to be operated to adjust the motorized window treatment into a service position in which access is provided to at least one battery within the headrail.