Techniques for implementing adaptive loop filtering are described. One example method of video processing includes making a first determination, for a conversion between a video unit of a video and a bitstream of the video, a first luma adaptive loop filter, ALF, boundary across which a luma adaptive loop filter is selectively applied to a luma component of the video unit and a second luma ALF boundary; making a second determination, from the second luma ALF boundary, a chroma ALF boundary across which a chroma adaptive loop filter is selectively applied for a chroma component of the video unit; and performing the conversion based on the first determination and the second determination.