An OLED display substrate, a method for manufacturing the same, and a display device are provided. The OLED display substrate includes multiple sub-pixels, and at least one sub-pixel includes: an anode, a cathode, and a light-emitting layer between the anode and the cathode. The anode includes: a light-reflective layer and a first transparent conductive layer covering the light-reflective layer, and the first transparent conductive layer is located between the light-reflective layer and the light-emitting layer. First vertical distances between first surfaces of the first transparent conductive layers of the subpixels of different colors facing the respective cathodes and the respective cathodes are the same, and second vertical distances between the first surfaces of the first transparent conductive layers of the subpixels of different colors and second surfaces of the respective light-reflective layers facing the respective cathodes are different.