A method of, and system for, selective video frame compression and decompression is presented. The disclosed technique is particularly suited for efficient event-driven searching in large databases. The technique involves designating certain frames in a video sequence as reference frames, to be compressed using a first compression technique, where the remaining frames are compressed using a second compression technique. The first compression technique may be implemented without requiring data from any neighboring frames.