An image processing apparatus includes an input unit configured to receive first material appearance data representing a material appearance of an image, a material appearance mapping unit configured to convert the first material appearance data into second material appearance data corresponding to a material appearance reproducible by a material appearance reproducing apparatus, and a conversion unit configured to convert the second material appearance data into control data for reproducing the material appearance of the image using the material appearance reproducing apparatus. The first material appearance data includes a gloss signal corresponding to a specular gloss and a gloss signal corresponding to an image clarity.