An apparatus for expanding or contracting image data includes an input for storing the image data to be processed, a first barrel shifter for shifting the output data of the input register, a control register for storing a mapping pattern which indicates a position of the image data bits to be extracted in the expansion mode or which indicates the number of times when the image data are to be copied, an expansion and contraction circuit for expanding or contracting the image data by referring to the mapping pattern, and a second barrel register for shifting the output image data of the expansion and contraction circuit before the data are loaded in an output data register.