The invention provides a device and a method for extracting caption areas, and aims to efficiently and accurately extract the caption areas from a video signal. Therefore, the device is provided witha video decoding unit, an image selection unit, an average unit and an extraction unit, wherein the video decoding unit decodes the video signal and generates multi-frame images; the image selection unit divides the multi-frame images output from the video decoding unit in chronological order into image groups in a predetermined size, and a predetermined number of images are selected for each image group based on the edge features thereof; the average unit averages the image groups and images selected by the image selection unit to obtain average images; and the extraction unit extracts cornerpoints from the average images and based on the corner points, the extraction unit extracts the caption areas from the average images. According to the invention, the caption areas can be extracted robustly even if a dynamic backdrop exists.