A head-mounted display apparatus worn on the head of a user and a method for controlling the head-mounted display apparatus are disclosed. The head-mounted display apparatus includes a gesture sensor that detects a swipe gesture manipulation that indicates a direction, the swipe gesture manipulation being performed in a manipulation space, a display, a processor, and a memory storing a program. The program, when executed by the processor, executes a switching operation, in which first display information to be displayed on the display is switched to second display information according to the direction indicated by the swipe gesture manipulation detected by the gesture sensor.