A video encoder generates an encoded video bitstream comprising a plurality of layers. At least one access unit of the encoded video bitstream includes one or more Instantaneous Decoding Refresh (IDR) pictures and one or more non-IDR pictures. The IDR pictures include only slices that are decoded using intra prediction only. The video encoder outputs the encoded video bitstream. A video decoder decodes the encoded video bitstream.