An optimization method for media data includes the following steps: determining the mode of a current playing frame after identifying that a current media data stream is a first media stream; obtaining, from a network side or a local place, a template file that corresponds to the mode for the first media stream; and optimizing the first media stream and obtaining a second media stream according to the template file, wherein the resolution of the first media stream is higher than that of the second media stream. The invention also provides an optimization device for media data. Through the technical scheme, the effects are as follows: the problem that a low-resolution screen cannot play media streams used for a high-resolution screen is solved; videos can be optimized in an intelligent manner according to hobbies of a user or the current display state of a display screen, and thus the user experiment is improved; and during optimization, image displaying effects that fit scenes can be optimized for corresponding scene frames according to the types of scenes in video signals.