A system and method for performing Bayer reconstruction of images using a programmable graphics processing unit (GPU) are described herein. A Bayer filtered image in RAW format is uploaded to the GPU, unpacked, and reconstructed. Optionally, the reconstructed image may be transformed into any desired color space and/or displayed by a video card in which the GPU resides. The reconstruction is performed independently on each of the red, blue, and green image fields. The red and blue image fields are reconstructed using first and second interpolation passes in first and second orthogonal directions. Each reconstruction pass preferably employs a two-lobed Lanczos filter. The green image field is interpolated using a single interpolation pass in a direction diagonal to the first and second orthogonal directions, and preferably employs a box filter.