An electrolyte structure for use in a solid oxide electrochemical device includes a first solid electrolyte and a metal support embedded in the first solid electrolyte such that the first solid electrolyte forms an anode-facing layer that covers an anode-facing surface of the metal support, a cathode-facing layer that covers a cathode-facing surface of the metal support, and two opposing side layers that cover side surfaces of the metal support to form a continuous path around the metal support.