An image display device includes a display panel, which includes a plurality of pixels and selectively implements a 2D image and a 3D image, and a patterned retarder for dividing light from the display panel, on which the 3D image is implemented, into first and second polarization components. The display panel includes first to fourth gate lines, which cross a data line and are disposed along a column direction in the order named, first and second pixels which are disposed between the first and second gate lines to be vertically adjacent to each other, third and fourth pixels which are disposed between the third and fourth gate lines to be vertically adjacent to each other, and a black matrix spatially for separating left and right images of the 3D image from each other.