A processor-implemented data processing method includes: predicting whether there will be an inefficient section, of a neural network set to be implemented, during a processing of data, based on a hardware configuration for processing the data; adjusting a layer parameter corresponding to the inefficient section of the neural network; and processing the data using the neural network with the adjusted layer parameter.