A method and an illumination manipulation device of performing an object illumination manipulation operation on a first image are provided. The method includes receiving the first image and an input of a light direction, generating a second image with a first object detected from the first image, determining a second object illumination of the second image based on the light direction and replacing a first object illumination of the first image with the second object illumination.