Systems, methods, and computer readable media for stitching or aligning multiple images (or portions of images) to generate a panoramic image are described. In general, techniques are disclosed for using motion data (captured at substantially the same time as image data) to align images rather than performing image analysis and/or registration operations. More particularly, motion data may be used to identify the rotational change between successive images. The identified rotational change, in turn, may be used to calculate a motion vector that describes the change in position between a point in a first image and a corresponding point in a subsequent image. The motion vector may be utilized to align successive images in an image sequence based on the motion data associated with the images.