Systems and methods of media servers for estimating the video quality of experience (QoE) of human viewers of video content or communications at video receivers. With these systems and methods, a media server can collect, within a plurality of predetermined time windows synchronized in time, operational parameters of ingress and egress networks over which such video content or communications can be transmitted, as well as coding parameters of a video decoder and a video encoder within the media server. Having collected the operational parameters of the ingress network and egress network and the coding parameters of the video decoder and video encoder, the media server can determine QoE scores associated with some or all the ingress network, the video decoder, the video encoder, and the egress network, and estimate a resulting video QoE for a human viewer at a video receiver as a predefined combination of the respective QoE scores.