A method and a device of extracting a label in a medical image are provided. The method includes: performing an edge detection on the medical image by using an edge detection algorithm, to acquire edge information in the medical image; determining at least one target area defined by the edge information; performing a fitting process on the at least one target area, to obtain a fitting area; and extracting the label in the medical image by selecting, from the fitting areas, at least one target fitting area matching a preset condition, wherein the preset condition is set based on a characteristic of the fitting area.