A medical image analyzing system and a medical image analyzing method are provided and include inputting at least one patient image into a first model of a neural network module to obtain a result having determined positions and ranges of an organ and a tumor of the patient image; inputting the result into a second model of a first analysis module and a third model of a second analysis module, respectively, to obtain at least one first prediction value and at least one second prediction value corresponding to the patient image; and outputting a determined result based on the first prediction value and the second prediction value. Further, processes between the first model, the second model and the third model can be automated, thereby improving identification rate of pancreatic cancer.