Methods, systems, apparatus for media processing are described. One example method of digital media processing includes performing a conversion between visual media data and a bitstream of the visual media data, wherein the performing of the conversion includes selectively applying a convolutional neural network filter during the conversion based on a rule, and wherein the rule specifies whether and/or how the convolutional neural network filter is applied.