A bitrate control device controls bitrate of video data and includes: a setting module that sets, for each frame in the video data, a target code amount to be used in encoding the frame by an encoding module for maintaining a given bitrate; an adjusting module that adjusts the target code amount set by the setting module based on given information; and a managing module that is configured to perform: saving a code amount corresponding to an amount reduced in the target code amount by the adjusting module in a virtual storage management buffer having a given upper limit, when the adjusting module adjusts to reduce the target code amount; and withdrawing a code amount corresponding to an amount increased in the target code amount by the adjusting module from the virtual storage management buffer, when the adjusting module adjusts to increase the target code amount.