An automatic track switching system is provided for a movable wall system having multiple wall panels (22) supported by and movable along multiple paths defined by multiple track sections (26-32) to predetermine configurations. The track switching system is operable by manually pushing each of the wall panels (22) along the track sections. Multiple switch assemblies (50, 70, 80) automatically direct each wall panel to an appropriate position based upon diverter means (115 et al.) associated with the trolley assemblies (85 et al.) for each wall panel. The switch assemblies include an array of vertically oriented plates (e.g., 255, 256, 257) that are each offset at different lateral distances from the track path. The diverter means for each trolley assembly includes a vertical pin (e.g., 123) that is situated at a predetermined lateral distance to engage a selected one of the switching plates. In one embodiment, each panel includes a lead trolley and a trailling trolley, with the vertical pin for each associated diverter means having different heights. The switching plates for different switch assemblies have heights calibrated to be engaged by only one of lead or trailing trolley.