When injecting pseudo random noise to an area centered on a block boundary, a video encoding device and a video decoding device prevent injection of pseudo random noise to an area including a reference image for subsequent planar mode filtering, in order to suppress linear artifacts. The video encoding device includes: an inverse quantization unit for inverse-quantizing a quantization index to obtain a quantization representative value; an inverse frequency transform unit for inverse-transforming the quantization representative value obtained by the inverse quantization unit, to obtain a reconstructed image block; and an adaptive distortion removal filter unit for injecting pseudo random noise to an area centered on a boundary of the reconstructed image block, wherein the adaptive distortion removal filter unit does not inject pseudo random noise to an area including a reference image for planar mode filtering.