A method for video frame analysis includes determining a first dissimilarity metric and a second dissimilarity metric. The first dissimilarity metric may correspond to a first difference between a first foreground of a first key frame in a video and a second foreground of a second key frame following the first key frame in the video. The second dissimilarity metric may correspond to a second difference between the second foreground of the second key frame and a third foreground of a third key frame following the second key frame in the video. A playback of the video may be generated based on the first dissimilarity metric and the second dissimilarity metric. Related systems and computer program products are also provided.