A defect inspection apparatus for inspecting an object to be inspected for a defect by processing an image taken from the object, includes: neural networks provided respectively for individual defect types to be classified; a learning unit which makes the neural networks learn based on the corresponding defect types to be classified; and a defect detection unit which classifies and detects defect types using the neural networks that have learned.