In an example, a method of processing video data includes splitting a current block of video data into a plurality of sub-blocks for deriving motion information of the current block, where the motion information indicates motion of the current block relative to reference video data. The method also includes deriving, separately for each respective sub-block of the plurality of sub-blocks, motion information comprising performing a motion search for a first set of reference data that corresponds to a second set of reference data outside of each respective sub-block. The method also includes decoding the plurality of sub-blocks based on the derived motion information and without decoding syntax elements representative of the motion information.