A method for decoding a video signal using a graph-based transform, where the method includes: receiving a template index for a target unit from the video signal, wherein the template index indicates a graph-based transform template to be applied to the target unit; deriving a graph-based transform matrix for the target unit corresponding to the template index; and decoding the target unit based on the graph-based transform matrix. In some scenarios, this enables efficient compression of inter-predicted residual blocks by using graph-based transform templates. The graph-based transform template may enable adaptive transform selection, thus achieving improved coding gain. Further, by defining a graph-based transform template or a template index, coding with a low-complexity is enabled that can reduce the number of bits to be transmitted to the decoder.