An artificial intelligence (AI) system for simulating functions such as recognition, determination, and so forth of a human brain by using a mechanical learning algorithm such as deep learning, or the like, and an application thereof are provided. A method of filtering video by a device is provided. The method includes selecting at least one previous frame preceding a current frame being played from among a plurality of frames included in the video, generating metadata regarding the selected at least one previous frame, predicting harmfulness of at least one next frame to be displayed on the device after playback of the current frame, based on the generated metadata, and filtering the next frame based on the predicted harmfulness.