Techniques are described in which a video decoder is configured to partition, into a plurality of sub-blocks, a block of a picture of the video data. The video decoder is further configured to, for each respective sub-block of the plurality of sub-blocks, derive a respective first motion vector of the respective sub-block based on motion information for at least two blocks neighboring the respective sub-block. The video decoder also determines, based on a respective motion vector difference for the respective sub-block signaled in a bitstream, a second motion vector for the respective sub-block. Additionally, the video decoder generates, based on the first motion vector of the respective sub-block and the second motion vector of the respective sub-block, a predictive block for the respective sub-block.