Tools and techniques for applying scan patterns during encoding and decoding of interlaced video are described. For example, a video decoder scans transform coefficients from a one-dimensional array to a two-dimensional block according to a scan pattern. The block is 4×4, and the scan pattern biases the vertical direction by starting with the DC coefficient and three AC coefficients of the lowest horizontal frequency. Or, the block is 8×4, and the scan pattern biases the vertical direction by starting with the DC coefficient and three AC coefficients of the lowest horizontal frequency. Or, the block is 4×8, and the scan pattern biases the horizontal direction for the lowest frequency AC coefficients in the horizontal and vertical directions but biases the vertical direction for at least some other AC coefficients. A corresponding video encoder applies the scan patterns to scan transform coefficients from two-dimensional blocks to one-dimensional arrays.