A method and apparatus for deriving a motion vector predictor (MVP) candidate set for motion vector coding of a current block. Embodiments according to the present invention determine a redundancy-removed spatial-temporal MVP candidate set. The redundancy-removed spatial-temporal MVP candidate set is derived from a spatial-temporal MVP candidate set by removing any redundant MVP candidate. The spatial-temporal MVP candidate set includes a top spatial MVP candidate, a left spatial MVP candidate and one temporal MVP candidate. The method further checks whether candidate number of the redundancy-removed spatial-temporal MVP candidate set is smaller than a threshold, and adds a zero motion vector to the redundancy-removed spatial-temporal MVP candidate set if the candidate number is smaller than the threshold. Finally, the method provides the redundancy-removed spatial-temporal MVP candidate set for encoding or decoding of the motion vector of a current block.