A worksite classification system and method for classifying persons at a worksite is disclosed. The worksite classification system can include a sensor system configured to capture images of persons located at the worksite. An electronic data processor communicatively coupled to the sensor system and comprising a computer readable storage medium having machine readable instructions that, when executed by the electronic data processor, cause the processor to: determine an identity of the persons based on one or more identifying characteristics associated with the persons; determine if the persons have authorization access to enter to one or more operational zones at the worksite based on the identity of the persons and an associated access level; and generate an alert notifying an operator when persons without authorization access enters the one or more operational zones.