Methods and apparatus for cleaning a surface with a cleaning device having a body with a handle, a connector, and one or more cleaning heads that are removably attached to the cleaning device are disclosed. Each cleaning head includes a lower surface arranged to contact a surface to be cleaned, a dirt collection chamber, and a pocket arranged to receive an insert of the connector to attach the cleaning head to the cleaning device. In some embodiments, the connector insert is pivotally connected to the connector. In some embodiments, the cleaning head includes a support structure and a cleaning sheet, with the pocket being formed between the support structure and the cleaning sheet.