A structural attachment system for a cargo management system is fully integrated into the cargo bed side walls of a pick-up truck so that the only feature that is different than a standard pick-up is an array of holes along the top of the cargo bed side walls. The cargo management system also includes a wide range of different pick-up truck cargo bed mounted accessories that incorporate structural hooks that are adapted to be retained and released by the structural attachment system. Additionally, the structural attachment system provides a single point, simple method of retention and release via an actuation handle at the rear most point of the pick-up truck cargo bed. The configuration of the structural attachment system allows significant structural retention forces to be transferred from the accessories into the pick-up truck cargo bed side walls via the structural hooks.