A video coding mechanism for viewpoint dependent video coding is disclosed. The mechanism includes receiving a spherical video signal stitched from multiple directional video streams. The spherical video signal is mapped into a plurality of sub-picture video signals each containing a sequence of sub-pictures. The plurality of sub-picture video signals, are encoded as a plurality of sub-picture bitstreams, such that, when decoded at a decoder, a value of each sample in each sub-picture is identical to a value of a corresponding sample in a decoded entire picture composed from the sub-pictures. The plurality of sub-picture bitstreams are composed into a plurality of sub-picture tracks with an indication that the sub-picture tracks are conforming to a particular video profile. The sub-picture bitstreams are transmitted toward a decoder to support decoding and displaying virtual reality video viewport.