The generation and delivery of key frames to clients of a video conference are performed in response to a need for a synchronization point. Instead of automatically sending a key frame periodically to each of the clients in the video conference, a key frame is sent to one or more clients upon the occurrence of an event in the video conference. For example, a key frame may be sent to a client when the client joins the video conference. A key frame may also be sent to a client that has packet loss, upon the request of a client, a speaker change within the video conference, when a new stream is added by the client, and the like. The clients in the video conference that are not affected by the event continue to receive predicted frames.