A vertical member, which is preferably a support post used in a molten metal pump, includes a ceramic tube and tensioning structures to add a compressive load to the tube along its longitudinal axis. This makes the tube less prone to breakage. A device, such as a pump, used in a molten metal bath includes one or more of such vertical members.