A screen display control method includes: by using a wearable terminal to be attached to a head of an operator to capture an image, capturing, with an image of a display having a rectangular frame and a viewport, an image of a hand portion with which the operator points to the display; by using a computer, extracting positions of vertexes of the rectangular frame in the captured image by the wearable terminal and a position pointed by the hand portion; determining, based on a position relation of the extracted positions of the vertexes and the extracted pointed position, whether a position in the viewport corresponding to the hand portion is present; and causing a pointer to be displayed at the position if present.