Specified video segments within a video stream are identified. The identified video can represent commercials or can represent portions within the program information. The user can identify these undesired portions of the video. A signature generation unit produces a signature that indicates information about the undesirable video. The signatures are stored. Current video is compared with the signatures to identify portions of the video that correspond to the specified video segments. The identified portions are handled in a different way, for example, they can be played less prominently, or skipped. The signal indicative of the video stream can be produced at a different time than the signature generation. In addition, the signature generation can use biometric techniques.