A device determines a Compact Multi-Pass Transform (CMPT) from a plurality of CMPTs. Additionally, the device decompresses CMPT parameters for the CMPT. In instances where the device decodes video data, the device applies the CMPT to a coefficient block to reconstruct a residual block and decodes, based on a predictive block and the residual block, a current block of a picture of the video data. In instances where the device encodes video data, the device applies the CMPT to a residual block to construct a coefficient block and generates for output information indicating coefficient values for the coefficient block.