Systems, devices, and methods related to using model architecture search for hardware configuration are provided. A method includes receiving, by a computer-implemented system, information associated with a pool of processing units; receiving, by the computer-implemented system, a data set associated with a data transformation operation; training, based on the data set and the information associated with the pool of processing units, a parameterized model associated with the data transformation operation, where the training includes updating at least one parameter of the parameterized model associated with configuring at least a subset of the processing units in the pool; and outputting, based on the training, one or more configurations for at least the subset of the processing units in the pool.