A cleaning apparatus for removing foreign matters from workpieces in the form of strips or sheets cut from a larger blank, before the workpiece is subjected to a press forming operation, which apparatus includes a feeding device for feeding the successive workpieces, de-oiling rolls disposed in an upstream portion of a feed path of the workpieces as seen in a feeding direction and rotated in pressing rolling contact with the surfaces of each workpiece as each workpiece is fed, so as to remove by absorption oily substances from the surfaces of the workpiece, and tacky rolls disposed downstream of the de-oiling rolls as seen in the feeding direction and rotated in pressing rolling contact with the surfaces of the workpiece, so as to remove by tackiness thereof the foreign matters from the surfaces of the workpiece.