A basketball goal assembly (10) includes a base (11), a pole assembly (12) carried by the base (11), a rim assembly (14) pivotally carried by the pole assembly (12) and a backboard (13) carried by the pole assembly (12). The pole assembly (12) has a front face (21) having a recess (27) therein. A lug (36) on the rim assembly (14) is received in the recess (27) to hold the rim assembly (14) in a useable condition. Upon a downward force on the rim assembly (14), the rim assembly (14) breaks away from the pole assembly (12) as the lug (36) comes out of the recess (27). A yoke (59) extends between the base (11) and the pole assembly (12) to assist in supporting the pole assembly (12). However, the yoke (59) may be removed from the pole assembly (12) and the base (11) and positioned in a compartment (64) formed in the base (11). The pole assembly (12) may then be rotated to be generally flat with the base (11) and to be positioned over the yoke (59). A scoring system (44) may also be provided on the pole assembly (12).