Method and system are provided for providing instructions during remote viewing of a user interface. The method carried out at a host computer system includes: capturing an image of one or more application user interfaces as displayed at the host computer system; and serializing data of each application user interface to provide a map of each window class and containers and/or control elements of the window class, wherein a container has attributes and child control elements. The captured image and the map are transmitted to a remote computer system; and control element input instructions are received from a remote computer system for instructing an interaction with a control element.