A caisson is modified to include side tabs thin can be gripped by side-mounted clamps on a vibratory hammer so that the caisson may be lifted into position from a horizontal position, oriented vertically, and driven into the ground without readjustment of the clamping of the vibratory hammer. An end cap installed permanently at the top of the caisson may provide an additional flange for receiving a lower clamp of the vibratory hammer to complete installation of the caisson, driving the caisson further into the earth until the tabs are buried in the ground. The flange may be sized to fit within a tower portion attached to the caisson eliminating the need for a replaceable flange system.