A method and apparatus for encoding and decoding image data. The method of encoding image data includes spatially predicting pixel values of a one-dimensional block of an image using blocks spatially adjacent to the one-dimensional block or temporally predicting the pixel values of the one-dimensional block using a temporally previous frame; transforming and quantizing the pixel values of the one-dimensional block; and generating bit streams for a one-dimensional conversion block when the transformed and quantized one-dimensional block is defined as the one-dimensional conversion block. Therefore, since the method and apparatus encode and decode image data in one-dimensional block units, real-time encoding and decoding can be achieved. In addition, compression efficiency can be enhanced while minimizing visual degradation of image quality.