An illustrative video conference management system monitors an encoded video stream corresponding to an original real-time video stream of a video conference meeting. The video conference management system determines context data associated with one or more encoded video frames of the encoded video stream. The context data includes at least one of an encoder metric or a content attribute that indicates an encoding complexity level of the original real-time video stream. The video conference management system adjusts one or more encoded video streams corresponding to the original real-time video stream based on the context data. Corresponding methods and systems are also disclosed.