A method and apparatus to improve compression efficiency in a video compression scheme enables flexible use of local illumination compensation. Such methods comprise individual local illumination compensation for components of a video block. Such methods also comprise flexible derivation methods for illumination compensation information. In one embodiment, local illumination compensation information can be inherited from other others, such as neighboring blocks.