A system includes an interface unit to receive a request, from a media client, to obtain a segment of media content at an ABR representation, and a transcoding unit. The transcoding unit includes a scalable decoder, hint stream decoder, and re-encoder. The scalable decoder receives and decodes a set of two or more layers of a scalable coded representation corresponding to the requested segment of media content at the requested ABR representation to provide a set of media frames and scalable stream information for the segment. The hint stream decoder receives and decodes a hint stream corresponding to the requested segment of media content at the requested ABR representation and the scalable stream information to provide transcoding hints for the segment. The re-encoder re-encodes the set of media frames using the transcoding hints to provide an encoded bit stream corresponding to the requested segment of media content.