An upright vacuum cleaner which is convertible for floor cleaning and above the floor cleaning, has a housing mounted on a floor nozzle in which a vacuum is drawn. A hose extending from the housing is insertable into a conduit which leads into the floor nozzle for floor cleaning. The hose also receives tools for above the floor cleaning. These tools are removably held in a tool holder on the rear wall of the housing with recesses and lands in the wall which is flexible. The recess at one end of the wall is defined by a member which overlaps the wall to define a lip. A nozzle for above the floor cleaning snaps over the lip and is held in the compartment between the wall and the end of a land between the recesses with the mouth of the nozzle behind the lip and the open end of the nozzle opposite its mouth on a rib on the end of that land which catches the open end of the nozzle.The flexible wall can readily be depressed so as to release the nozzle when it is to be used.