The invention discloses a rice seed impurity removal device. The rice seed impurity removal device comprises a herringbone pipeline (1). The pipeline (1) comprises a feeding pipeline (11) and two discharging pipelines (12) connected with the lower end of the feeding pipeline (11), the upper end of the feeding pipeline (11) is connected with a charging hopper (2), conveying belts (6) are arranged below the two discharging pipelines (12), the front ends of the conveying belts (6) are located below the discharging pipelines (12), and a collecting bin (7) is arranged below the tail ends of the two conveying belts (6). A plurality of vibrators (5) are arranged below the discharging pipelines (12), notches are arranged above the discharging pipelines (12), the number of the notches is the same as that of the vibrators (5), the notches are used for allowing electromagnetic rollers to pass partially, and the notches are in one-to-one correspondence to the vibrators (5) at the up-and-down positions. The rice seed impurity removal device can effectively remove small iron chips from rice.