Disclosed are an apparatus for inspecting defect of a rubbing cloth and a rubbing apparatus with the same. The apparatus for inspecting defect of the rubbing cloth includes a housing surrounding the periphery of the rubbing cloth, a transfer unit connected to the upper portion of the housing for transferring the housing along a length direction of a rubbing roll, an illumination unit installed at one side in the housing for illuminating the rubbing cloth, and a camera unit installed at the other side in the housing to correspond to the illumination unit on the basis of the rubbing roll. The apparatus for inspecting defect of the rubbing cloth can rapidly and precisely detect the defect of the rubbing cloth by using the illumination unit and the camera unit.