A travel management device detects that a moving body is traveling in a wrong direction on a travel path on which the moving body is currently traveling, based on at least one of a front recognition result and a rear recognition result, the front recognition result indicating display content displayed by a sign appearing in a front captured image, the front captured image being obtained by capturing an image to front of the moving body, the rear recognition result indicating display content displayed by a sign appearing in a rear captured image, the rear captured image being obtained by capturing an image to rear of the moving body. Furthermore, the travel management device detects a possibility of the moving body traveling in a wrong direction in future on a travel path located ahead in a travel direction of the moving body than the travel path on which the moving body is currently traveling, based on at least one of the front recognition result and the rear recognition result.