Method and apparatus for coding a block of video data using palette coding in a video coding are disclosed. According to one embodiment, whether there is only one single palette index in the current block is determined first. If there is only one single palette index in the current block, signaling a current palette index map for the current block is omitted at an encoder side or parsing any syntax for decoding the current palette index map for the current block is omitted at a decoder side. The decision regarding whether there is only one single palette index in the current block is based on one or more syntax elements not corresponding to palette index coding.