A remote desktop client application on a client device receives screen data from a remote desktop on a remote server and displays a portion of the remote desktop, a mode icon, and direction icons. In a first mode, the remote desktop client detects a direction icon being selected by the user's eye movements and locally scrolls the remote desktop to display another portion of the remote desktop. The remote desktop switches to a second mode after detecting the mode icon being selected based on the user's eye movements. In the second mode, the remote desktop client detecting a direction icon being selected by the user's eye movements and sends a scrolling command to remotely scroll in the remote desktop. The remote desktop client receives updated screen data of the remote desktop from the remote server and displays the other portion of the remote desktop based on the updated screen data.