A method and system that implement a process for managing video information on a video recording device. The management process involves receiving a video input signal including a video stream, obtaining content information corresponding to the video stream, associating the content information with the video stream, and storing the video stream and associated content information in a database as a searchable index for the video stream. The searchable index includes location of the stored video stream and identifies the associated content information. Then, content information from an input signal corresponding to a video stream is captured for analysis and searching the index to identify stored video streams related to the video program for suggestion to the user.