An exemplary method for variable speed video playback comprises obtaining a set of scores for a plurality of discrete segments in a digital video, enabling a playback of the digital video at a variable playback speed that may change from segment to segment based on the set of scores, receiving a user input to adjust the playback speed for at least one of the segments by modifying at least one of the set of scores, and adjusting the variable playback speed based on the user input.