An image decoding method includes: obtaining setting information for setting a first quantization matrix; and inverse-quantizing coefficients of the image, using the first quantization matrix set according to the setting information. In the inverse-quantizing: when the setting information includes specifying information for specifying a second quantization matrix and the second quantization matrix specified by the specifying information is referable, the second quantization matrix is set as the first quantization matrix; and when the setting information includes the specifying information and the second quantization matrix specified by the specifying information is not referable, a third quantization matrix which is referable may be set as the first quantization matrix.