A video reproducing/recording and playing system and a method thereof for setting and playing video sections are provided. The system includes a host computer with a data buffer and a database, a video module, and a monitor. While continuously receiving video signals, the video module sets a first section index when a scene difference between a first frame and a second frame represented by a portion of the video signals is greater than a predetermined scene difference wherein the first section index points to a start time of the second frame. Then, the video module stores the first section index and stores the video signals corresponding to the second frame into the data buffer. After retrieving the first section index, the monitor presents the video signals from the second frame points by the first section index.