The invention discloses a matrix register file for supporting the whole reading and writing operations of a matrix and aims to provide a matrix register file that supports the one-off reading operation of all row or line data of the whole matrix and the one-off writing operation of all row or line data of the whole matrix. The matrix register file comprises a matrix register file memory bank, a read access port and a writing access port; the reading access port comprises a read row-line address encoder, a read data buffer and a read controller, wherein the read controller comprises a read state machine, a read counter and a read summator; and the writing access port comprises an address encoder and a writing controller, wherein the writing controller comprises a writing state machine, a writing counter and a writing summator. The invention can realize the whole matrix operation by adopting a single-matrix instruction, thereby improving the code density and reducing the memory expense and the system consumption.