The embodiment of the invention discloses a method and device for hierarchically controlling a data exchange rate, and the method comprises the steps: monitoring the concurrency number of data exchange channels in real time, and adjusting the concurrency number of the data exchange channels according to the load condition of an underlying physical network; monitoring the flow rate of the data recording flow in real time, and performing data recording flow limiting control according to the relationship between the flow rate of the data recording flow and a first preset flow rate; and monitoringthe flow rate of the data byte stream in real time, and performing data byte stream current limiting control according to the relationship between the flow rate of the data byte stream and a second preset flow rate. According to the embodiment of the invention, on the basis of traditionally limiting the network rate of a data exchange underlying physical network; the data exchange rate is controlled from the three aspects of the concurrent number of the data exchange channels, the flow rate of the data byte streams and the flow rate of the data record streams, so that the data exchange rate on the data exchange channels can be accurately controlled, and the throughput and stability of a data exchange system are improved.