A system and method are disclosed for processing data content. Received data content comprises a scene and includes one or more recognized objects. The recognized object(s) include various characteristics, and can be detected and tracked during content capture. The data content can then be stored, and incorporated with metadata associated with the recognized object and/or one or more other elements in the data content. User inputs can be enabled in real-time, or post-capture, to augment one or more of the elements in the stored data content, including one or more characteristics of the recognized object. The data content can then be augmented to introduce one or more augmented elements, corresponding to respective elements of the data content, into the data content based on the user inputs.