A milk pump for pumping milk from a woman's breast comprises a breast hood for receiving tightly a woman's breast. Furthermore, there is a milk collecting arrangement for receiving milk pumped from said woman's breast. This milk collecting arrangement includes a support and a downwards directed opening in the support for providing a suction communication to the breast hood. Moreover, the milk collecting arrangement comprises a manual pumping unit above the said opening. The manual pumping unit includes a wall forming and surrounding a displacement space which comprise a front wall and a peripheral wall extending in longitudinal direction. A suction device is displaceable inside the displacement space to provide suction through the opening, wherein the displacement is provoked by an actuation device. Furthermore, there is a latching arrangement for releasably connecting at least part of the wall of the displacement space to the support for an easy exchange.