An optical element includes a light guide plate, an incidence portion, and an emission portion, in which each of the incidence portion and the emission portion includes diffraction portions, the diffraction portion includes diffraction elements, the diffraction element includes a liquid crystal diffraction layer in which a direction of an optical axis of a liquid crystal compound changes while continuously rotating in one in-plane direction, and in a case where the direction in which the direction of the optical axis changes is set as an in-plane rotation direction and a length over which the optical axis rotates by 180° is set as an in-plane period, in-plane rotation directions of liquid crystal diffraction layers of incidence diffraction elements in at least two of a plurality of the incidence diffraction portions are different from each other.