A baluster apparatus, for removably locking a baluster in a balustrade having opposite upper and lower surfaces, having a pair of connector bases, each comprising a base member having a bottom surface for mounting to the balustrade surfaces, a top surface; a wall extending from the top surface and defining an inner wall surface, and an outer wall surface that tapers inwardly from the top surface; a baluster having baluster ends, wherein the wall of each connector base is configured to laterally receive a baluster end for a close fit there between, wherein the baluster is insertable into and removable from the connector bases without removing the connector bases from the one of the upper or lower surfaces or without moving the upper or lower surfaces apart; and a pair of connector covers each being slidable along a portion of the baluster, each connector cover comprising a tubular member having an upper portion defining a first opening configured to fit around the baluster, a lower portion defining a second opening configured to closely fit around the base member, and an internal wall configured to closely abut the outer wall surface of the wall and having a complementary taper to the outer wall surface so as to urge the wall toward the end of the baluster to provide frictional engagement between the inner wall surface and the end of the baluster when the second opening is slid onto the base member.