A method and system thereof for handing off a media session are described. In one embodiment, a first media segment is forwarded to a client node. The first media segment includes a portion of an item of media content stored in lieu of storing the item of media content in its entirety. The item of media content is segmented according to segmentation characteristics. Handoff information used for transferring the media session to another server node is specified. The handoff of the media session to the other server node occurs when the forwarding of the first media segment is completed, such that the handoff occurs between media segments.