A color filter substrate and manufacturing method thereof, a liquid crystal display panel and a display device are disclosed. The color filter substrate comprises a substrate, and a black matrix film layer and a color filter layer on the substrate. The black matrix film layer has a plurality of opening regions arranged in an array, the color filter layer is fed into the opening regions, and the color filter layer has an overlapping region with the black matrix film layer at a contact position. The present disclosure can eliminate the angle section difference of the color filter layer on the color filter substrate, improve the smoothness of the alignment layer surface located on the color filter layer, and avoid non-uniform rubbing alignment on the alignment layer surface caused by the un-smooth alignment layer surface, thereby avoid light leakage and the problem of the bad liquidity of the liquid crystal.