In some implementations, a computing device can perform multi-display alignment through observed user interactions. The computing device can receive user input aligning a first alignment object on a first display device with a second alignment object on a second display device. The computing device can align the display buffers for each display device based on the positions of the alignment objects in each display buffer corresponding to each display device. The computing device can align display buffers based on observed movements of graphical objects between multiple display devices. When display buffers corresponding to the display devices are misaligned, the user may correct the path of a graphical object when moving the graphical object between display devices. The computing device can detect the correction and align the display buffers of the display devices so that graphical objects are presented at the appropriate locations when moved between the display devices.