A bi-polar battery has a positive electrode unit, a negative electrode unit, at least one bi-polar electrode unit stacked therebetween, an electrolyte layer separating each adjacent electrode unit, and a gasket positioned about each electrolyte layer for creating a seal about the electrolyte layer in conjunction with the electrode units adjacent thereto. The bi-polar battery also includes a wrapper for maintaining the seals created by the gaskets.