An image encoding device (1) according to a first feature encodes blocks obtained by dividing an original image of a frame included in a video. The image encoding device (1) includes a code amount allocator (180) configured to allocate a code amount to each of a plurality of intra prediction modes defined in advance, a mode selector (171) configured to select an intra prediction mode to be applied to a target block of intra prediction from among the plurality of intra prediction modes, and an encoder (130) configured to encode identification information indicating the selected intra prediction mode in accordance with the allocated code amount. The code amount allocator (180) calculates a feature amount of a plurality of reference pixels adjacent to the target block and changes a manner of allocation of code amounts to the plurality of intra prediction modes based on the calculated feature amount.