The invention discloses a scene text end-to-end recognition method based on boundary point detection, and the method comprises the steps: extracting text features through a feature pyramid network, and generating candidate textboxes through a region extraction network; detecting a more accurate multi-directional bounding box of the text instance through a multi-directional rectangular detection network; secondly, detecting an upper boundary point sequence and a lower boundary point sequence of the text in the multi-directional bounding box; and finally, converting the text in any shape into ahorizontal text by utilizing the detected boundary point sequence for the subsequent attention mechanism-based sequence recognition network to performing recognizing, and finally, finding out the mostmatched word of the prediction sequence in the given dictionary by utilizing a cluster search algorithm to obtain a final text recognition result. According to the method, the scene text in any shapein the natural image can be detected and recognized at the same time under the condition that character-level labeling is not needed, the scene text comprises the horizontal text, the multi-directiontext and the curved text, and end-to-end training can be completely carried out.