Optical assemblies include a stack of optical elements each of which has one or more alignment features. Each alignment feature traces a respective curve along a surface of one of the optical elements. The alignment feature(s) of one optical element fit within the alignment feature(s) of the other. In some cases, the alignment features can help establish more precise lateral alignment of the optical elements.