An interim filter determined for a previous series of video blocks can be applied to a current series of video blocks to determine an interim filter map for the current series of video blocks. Based on the interim filter map, a decoding filter can be determined. By applying the decoding filter to the current series of video blocks, a decoding filtering map can be determined. Based on CUs identified as having filtering off by the decoding filtering map, an interim filter for the current series of video blocks can be determined. The decoding filter and decoding filtering map can be transmitted to a decoder, while the interim filter and interim filter map may not be transmitted to a decoder. The interim filter for the current series of video blocks can be used to generate an interim filter map for a next series of video blocks.