There are provided an image processing apparatus, an image processing method, a program, and a recording medium capable of compatibly achieving a high-accuracy filtering process and reduction in a necessary storage capacity. An image processing apparatus 35 includes a filtering process unit 41 that performs an image filtering process including a plurality of filtering processes. The filtering process unit 41 applies a filter to processing target data to acquire filter application process data, and applies a gain to the filter application process data to acquire gain application process data, in each filtering process. In each filtering process, the gain applied to the filter application process data is acquired based on a target frequency characteristic of the image filtering process determined according to a pixel position in original image data.