An image encoding device includes a prediction processing unit which performs prediction processing on m components among N components which constitute a quantized block; a first Coded Block Pattern (CBP) judging unit which judges whether or not (N−m) components include a non-zero component in a first operation mode, and whether or not (N−n) components include a non-zero component in a second operation mode; a second CBP judging unit which judges whether or not the m components on which the prediction processing has been performed include a non-zero component in the first operation mode, and whether or not n components include a non-zero component in the second operation mode; and a CBP generating unit which generates a CBP code indicating whether or not all the components of the block are 0 components based on the judgments made by the first and second judging units.