According to an embodiment, a structure evaluation system includes a plurality of AE sensors, a signal processor, a position locator, a velocity calculator, and an evaluator. The AE sensors detect an elastic wave generated from a structure. The signal processor extracts an AE signal including information on the elastic wave by performing signal processing on the elastic wave detected by the AE sensor. The position locator derives a wave source distribution indicating a distribution of sources of the elastic waves generated in the structure on the basis of the AE signals. The velocity calculator derives a propagation velocity of the elastic wave generated in the structure on the basis of the AE signal. The evaluator evaluates the soundness of the structure on the basis of the wave source distributions and the propagation velocity of the elastic waves.