A computer controlled video re-editing system with a "Domino" re-edit function. An edited video comprises a set of ordered video segments. In a video re-editing system a user can re-edit an edited video by adjusting the duration of each video segment. When a user adjusts the length of a video segment, the Domino re-edit function examines how the re-edit to the edited video work affects nearby video segments in the edited video work. The Domino re-edit function then propagates the effects of a re-edit by moving the nearby video segments forward or backward along a time line to accommodate the re-edit made. The Domino re-edit function utilizes any empty spaces that exist in an edited video work such that the empty spaces are filled before the effects of a re-edit are propagated to another video segment. If there is sufficient empty space between video segments, the effects of the re-edit cease propagating. To prevent a video segment from being moved by the Domino re-edit function, a user can "lock" the video segment to a reference time line. To preserve a relative relationship between two video segments, a user can lock the two video segments together.