Systems and methods for video episode viewing and mining comprise: receiving video data comprising a plurality of frames representing images of one or more objects within a physical area; identifying a plurality of events within the video data, wherein an event represents a movement of an object of interest from a first location in a grid associated with the physical area to a second location in the grid; generating a plurality of event data records reflecting the plurality of events; and determining one or more frequent episodes from the plurality of event data records, wherein an episode comprises a series of events associated with a particular object of interest.