Systems and method for streaming video content include downscaling video content using a downscaling model to generate downscaled video content and downloading the downscaled video content as a video stream and corresponding upscaling model to a client device. The system converts received video frames to a video memory format comprising channels having the same memory allocation size, each subsequent channel arranged in an adjacent memory location, for input to the downscaling model. The client device upscales the video stream using the received upscaling model for display by the client device in real-time. A training system trains the downscaling model to generate the downscaled video content, based on associated metadata identifying a type of video content. The downscaled video content and associated upscaling models are stored for access by an edge server, which downloads upscaling models to a client device to select an upscaling model.