A video encoder maintains a first reference picture list; maintains a second reference picture list; determines that a picture is an instantaneous decoding refresh (IDR) picture; determines that reference picture list syntax elements are present in a slice header for the IDR picture; and in response to determining that the picture is the IDR picture and that the reference picture list syntax elements are present in the slice header for the IDR picture, updates the first reference picture list and the second reference picture list such that no picture in the first reference picture list and no picture in the second reference picture list precedes, in output order or decoding order, any preceding instant random access point (IRAP) picture in decoding order.