A medical image analyzing system and a medical image analyzing method are provided and include inputting at least one patient image into a first model of a first neural network module to obtain a result having determined positions and ranges of an organ and a tumor of the patient image; inputting the result into a plurality of second models of a second neural network module, respectively, to obtain a plurality of prediction values corresponding to each of the plurality of second models and a model number predicting having cancer in the plurality of prediction values; and outputting a determined result based on the model number predicting having cancer and a number threshold value. Further, processes between the first model and the second models can be automated, thereby improving identification rate of pancreatic cancer.