The present disclosure describes a video data processing method and a device. An example method includes: determining, by a network device, a video bitrate, a volume of scheduled video data, and video-played duration of a video service of a terminal; determining, by the network device, a buffer time of the video service of the terminal based on the video bitrate, the volume of scheduled video data, and the video-played duration; and performing, by the network device, video data scheduling on the terminal based on the buffer time.