A method and system are provided for assigning metadata candidates to a commercial by performing image analysis on a plurality of the video frames to identify video frames that include one or more of identifiable product-related logos, brand-related logos, product-related text, or brand-related text which appear in the video frames, performing audio analysis on the commercial to identify audio associated with one or more identifiable products or brands in the commercial, comparing the products and brands identified by the image analysis with the products and brands identified by the audio analysis, and identifying similar products and brands; and assigning to the commercial a product or brand as a primary metadata candidate when a similar product or brand is identified by the image analysis and the audio analysis.