A method enhances brightness in video frames of a video during streams. The method includes determining, by a processor, that a first video frame has low light. The method further includes applying, by the processor, a linear correction to provide a first brightness enhancement in the first video frame that modifies a first brightness of a predetermined darkest percentage of pixels to be less than a darkness threshold value or a second brightness of a predetermined lightest percentage of the pixels to be greater than a lightness threshold value. The method further includes averaging, by the processor, the first brightness enhancement of the first video frame with a set of brightness enhancements corresponding to previous video frames to generate a modified video.