A passage propriety assessment device, provided with: a assessment unit that authorizes a person to pass through a first entrance/exit when a first facial image of the person at the first entrance/exit satisfies an individual authorization criterion, which is a criterion for assessing by facial recognition that the person is a pass-authorized person; and a setting unit that, when it is assessed that a person who has been authorized to pass through the first entrance/exit is impersonating a pass-authorized person, sets the individual authorization criterion for a pass-authorized person for a second entrance/exit located after the first entrance/exit so as to be higher than the individual authorization criterion for the first entrance/exit. When a second facial image of a person at the second entrance/exit does not satisfy the individual authorization criterion that was set higher, the assessment unit restricts the person from passing through the second entrance/exit.