A method for analyzing data sequences, such as video and audio segments, and extracting metadata from the data sequences for providing information related to events of the data sequences. The metadata extracted is used for making editing decisions, such as for an audio-visual production comprised of a collection of video and audio segments. The metadata identifies events of importance in the video and audio segments, which may then be applied to the editing process. A user interface including the extracted metadata in a timeline format facilitates editing the audio-visual production.