The present invention relates to a signal processing apparatus and a method, a recording medium, and a program, in which portions except an edge can be smoothed while the edge whose change in pixel value is steep is held correctly. A pixel of attention is determined in step S11, and a neighboring pixel is determined in step S12. In step S13, a difference in pixel values between the pixel of attention and each neighboring pixel is calculated. In step S14, according to a relationship in size between the difference and a threshold value ε., flags are raised for the neighboring pixel and a neighboring pixel which are symmetrical. Furthermore, a flag is also raised for a neighboring pixel away from, in view of the pixel of attention, the symmetrical neighboring pixel for which the flag is raised. In step S15, 7-pixel taps centered around the pixel of attention are averaged by weight. However, with respect to the neighboring pixel for which the flag is raised, the pixel value is replaced by that of the pixel of attention C, and is calculated. The present invention can be applied to a video camera, a television receiver, etc.