In various examples, a high definition (HD) map is provided that includes a segmented data structure that allows for selective access to desired road segments and corresponding layers of map data. For example, the HD map may be segmented into a series of tiles that may correspond to a geographic region, and each of the tiles may include any number of road segments corresponding to portions of the geographic region. Each road segment may include a corresponding set of layers—which may include driving layers for use by the ego-machine and/or training layers for generating ground truth data—from the HD map that are associated with the road segment alone. As such, when traversing the environment, an ego-machine may determine one or more road segments within a tile corresponding to a current location, and may selectively download one or more layers for each of the one or more road segments.