A method for intra prediction mode decoding for a current block based on multi-level most probable mode (MPM) sets. The method includes determining one or more MPM candidates for a first-level MPM set, and determining one or more most probable remaining mode (MPRM) candidates for a second-level MPM set. Wherein the one or more MPRM candidates are identified based on a mode of a neighboring block of the current block, and the one or more MPRM candidates are different from any MPM candidate in the first-level MPM set. The method also includes decoding syntax information related to a current intra prediction mode corresponding to the current block according to the multi-level MPM sets using a decoder, and decoding the current block based on the determined current intra prediction mode.