A self-driving device control system of the present invention includes an entry restricted area, at least one entrance opened and closed by a closing member, a self-driving device, and a control device, and further includes an outside identification device, an inside identification device, and a storage device. When identification information is acquired by the outside identification device, the control device sets the self-driving device to a stopped state. If the storage device is not storing even one piece of entry identification information regarding a worker for which a corresponding piece of exit identification information regarding the same worker is not stored in the storage device, and furthermore all of the entrances are in a passage restricted state, the control device resumes the driving of the self-driving device.