Identifying individual facial images that are broadcast to enable optimized indexing and storage of facial information. Frames of data including faces are continually captured from a stream of incoming data. The facial frame data is extracted and processed into individual facial images. The individual facial images may be compared to existing facial image data in a database or cache to determine the identity of a facial image. The individual facial images may also be compared to facial images and metadata describing the facial images that are broadcast from external recording subsystems. The individual facial images stored to the glossary may be indexed based on the metadata received in the broadcast from an external recording subsystem or by metadata received from the continuous face frame capture.