A block of video data is split using one or more of several possible partition operations by using the partitioning choices obtained through use of a deep learning-based image partitioning. In at least one embodiment, the block is split in one or more splitting operations using a convolutional neural network. In another embodiment, inputs to the convolutional neural network come from motion vector fields and corresponding residuals. Methods, apparatus, and signal embodiments are provided for encoding.