Systems and techniques are described for providing a virtual interface for an XR device using a display interface device. A display interface device can display a landmark pattern, such as a quick response (QR) code, on its display. The display can be in the field of view of a camera of the XR device, so that camera captures images depicting the displayed landmark pattern. The XR device can generate, and display on its own display, output images based on the captured images, for instance by overlaying a virtual interface over the landmark pattern. The pose and/or size of the virtual interface in the output images can be based on the pose and/or size of the landmark pattern and/or display in the captured images. The display interface device can receive inputs through its display interface, such as touch-based inputs, which the display interface device can identify for the XR device.