A device and a method are provided for controlling an image of a vehicle for an image of a vehicle camera that does not have a built-in image signal processor (ISP). A communication device receives information on an operation mode of the vehicle from a vehicle system and a camera device that does not have a built-in ISP obtains an image of a surrounding region of the vehicle, and transmits the image of the surrounding region to a first image controller. The first image controller having a first ISP for performing image processing shares the image of the surrounding region with a second image controller having a second ISP for performing image processing. The first image controller and the second image controller alternatively have a control right for the camera device depending on the operation mode of the vehicle.