Systems and methods for improving cache efficiency and utilization are disclosed. In one embodiment, a graphics multiprocessor comprises a plurality of processing resources including a first set of processing cores and a second set of processing cores, wherein the first set of processing cores includes circuitry to execute instructions to perform matrix operations and the second set of processing cores includes circuitry to execute instructions to perform integer and floating-point operations; and a cache memory configured to be partitioned into multiple cache regions, wherein the multiple cache regions include a first cache region having a cache eviction policy with a configurable level of data persistence.