A video encoding device includes encoding control means 11 for controlling an inter-PU partition type of a CU to be encoded, based on the maximum number (PA) of motion vectors allowed for an image block having a predetermined area and the number (PB) of motion vectors of an encoded image block contained in the image block having the predetermined area. A video decoding device includes decoding control means for controlling an inter-PU partition type of a CU to be decoded, based on the maximum number (PA) of motion vectors allowed for an image block having a predetermined area and the number (PB) of motion vectors of a decoded image block contained in the image block having the predetermined area.