Video signal processing apparatus includes a picture enhancement processor for processing a video signal to produce an enhanced video signal. The video signal includes a signal component representing video image data and another signal component representing non-image data such as vertical sync and a binary information component. The binary information component represents binary information that may occur, for example, during vertical blanking such as closed caption data, content advisory information (V-chip), or extended data services information. A control unit modifies the enhancement performed by the picture enhancement processor during intervals of the video signal that include non-image information. Modifying enhancement processing (e.g., reducing or disabling) during intervals that include the non-image information reduces degradation of the non-image information caused by the enhancement processing.