A luminance and color separation filter unit (300, 400, 500, 600, 700) for extracting a luminance signal (Y) and two color signals (U, V) from a composite color television signal (CVBS), comprising a chrominance (C) signal being modulated on a subcarrier which is located in the high-frequency part of the frequency spectrum of the luminance signal (Y), is disclosed. The filter unit (300, 400, 500, 600, 700) is arranged to compute at least one value of a set of values comprising an output luminance value (Y(x, n)) of a particular output pixel (x), a first color value (U(x, n)) of the particular output pixel (x) and a second color value (V(x, n)) of the particular output pixel (x) on basis of a first (F1), a second (F2) and a third (F3) sample derived from the composite color television signal (CVBS), where the first (F1), the second (F2) and the third (F3) sample have mutually different sub-carrier phases.