There is provided a compression method for handling local brightness variation in video. The compression method estimates the weights from previously encoded and reconstructed neighboring pixels of the current block in the source picture and their corresponding motion predicted (or collocated) pixels in the reference pictures. Since the information is available in both the encoder and decoder for deriving these weights, no additional bits are required to be transmitted.