A system to remove sodium and Sulfur from a feed stream containing alkali metal sulfides and polysulfides in addition to heavy metals. The system includes an electrolytic cell having an anolyte compartment housing an anode in contact with an anolyte. The anolyte includes alkali metal sulfides and polysulfides dissolved in a polar organic solvent. The anolyte includes heavy metal ions. A separator includes an ion conducting membrane and separates the anolyte compartment from a catholyte compartment that includes a cathode in contact with a catholyte. The catholyte includes an alkali ion-conductive liquid. A power source applies a voltage to the electrolytic cell high enough to reduce the alkali metal and oxidize Sulfur ions to allow recovery of the alkali metal and elemental sulfur. The ratio of sodium to Sulfur is such that the open circuit potential of the electrolytic cell is greater than about 2.3V.