Methods and systems are provided for displaying 3D images using a display system having multiple physical layers. The physical layers of the display system are controlled (or manufactured) such that the display system produces a desired 4D light field corresponding to a real or synthetic 3D object or scene to be viewed by an observer. This may be accomplished, for example, by determining the transmittance values of one or more points in each physical layer that are required such that the desired 4D light field is produced by the display system. Various alternative embodiments are also disclosed.