A method and device derive a motion vector difference of a current block based on layer information and index information, where the layer information indicates a current layer to which a motion vector difference used in inter prediction of the current block belongs and index information indicates a specific combination in the current layer, and thereby the MVD coding efficiency may be significantly increased by coding the horizontal and vertical components of the MVD together based on layer information and index information.