Embodiments of the present disclosure are directed to apparatuses, systems, and techniques of offloading shader program compilation at a computing system. A detection is made that a set of shader programs are to be compiled for an application executing at a computing system using a first set of processing devices. A second set of processing devices to compile the set of shader programs is identified. Each of the second set of processing devices is different from any processing device of the first set of processing devices. The set of shader programs is provided for compilation using the second set of processing devices in view of state data associated with the computing system to obtain a set of complied shader programs. The set of compiled shader programs is executed using the first set of processing devices.