Concepts and technologies are disclosed herein for collective determination of interesting portions of a video program, video tagging, and jump playback within the video program. A processor can obtain interest inputs for video content associated with a video program and can send the information to an aggregator server. The aggregator server can collect and analyze the information, determine interest indications for interesting portions of the video program, generate metadata, and send the metadata to devices. Devices can use the metadata to enable jump functionality. The metadata can be correlated with recorded content that corresponds to the video program to indicate interesting portions of the recorded content. A user interface can be presented. The user interface can include a timeline for the video program and controls to navigate to portions of the video program that are indicated as interesting by the metadata.