An electronic device may be provided with a housing. A camera module may be mounted within the housing. The housing may have a camera window with which a lens in the camera module is aligned. To rotationally and laterally align the camera module with respect to the camera window and the electronic device housing, an alignment structure may be mounted to the housing in alignment with the camera window and housing. The alignment structure may be formed form a ring-shaped structure with an opening. The alignment structures may have sidewalls that form an alignment groove for the camera module. The camera window may be formed from a circular opening in a layer of opaque material deposited on a transparent housing member such as a planar layer of glass. During the process, a laser tool may be used to trim the opening in the opaque material.