In a device for removing toner or similar substance deposited on a recording sheet or similar sheet, projections are formed on a back-up member and located at portions on which the rear of a separating member slide. While a sheet is passed through a pressing portion in contact with the separating member, the projections raise the rear of the separating member toward the surface of the sheet carrying the toner. Hence, even solitary particles of the substance adjoining relatively thick and large masses of the substance can contact the front of the separating member. Hence, the solitary particles are prevented from remaining on the sheet.