The invention provides a method and a device for transmitting data between a network interface card and accelerators in a multi-processor system, wherein the multi-processor system comprises at least one core processor, a plurality of accelerators and a main memory which can be read by the core processor, the accelerators and the network interface card. The method comprises the following steps: the data transmitted between the network interface card and the accelerators is stored into the main memory in terms of a raw packet; a storage position identifier of the raw packet in the main memory is set; and the network interface card or the accelerators obtain the raw packet from the main memory according to the storage position identifier. The method and the device can optimize the data transmission process between an NIC drive and the accelerators in multi-processor systems such as CBE, and improve the data transmission efficiency of the systems.