Techniques are described for determining quality of experience (QoE) rate information for streaming video. For example, QoE rates can be calculated by a client while receiving and decoding an encoded video stream. The QoE rates can be calculated based on the number of video stalls that occur at the client while decoding the encoded video stream during a plurality of time periods. Determining whether a video stall occurs during a given time period involves comparing an encoded frame rate to a decoded frame rate. Indications of the QoE rates can be output.