The invention provides for a method of operating a magnetic resonance imaging system. The method comprises the steps of: acquiring (200) first magnetic resonance data (142) by controlling the magnetic resonance imaging system with pulse sequence instructions (140), reconstructing (202) one or more first image (144) from the first magnetic resonance data, and assigning (204) the one or more first image to a first memory group of a set of memory groups (300). The method further comprises repeatedly performing the following steps: acquiring (206) sequential magnetic resonance data (148) by controlling the magnetic resonance imaging system with the pulse sequence instructions, reconstructing (208) one or more sequential image (150) from the sequential magnetic resonance data, computing (210) a distance measure (152) between the one or more sequential image and each of the set of memory groups, assigning (214) the one or more sequential images to a chosen memory group if the distance measure between the chosen group and the one or more sequential images is within a predetermined range, creating (216) a subsequent memory group (304) in the memory if the one or more sequential images is not assigned to the chosen memory group, and assigning (218) the one or more sequential image to the subsequent memory group if the subsequent memory group is created.