An electronic device is provided. The electronic device includes a switch configured to select a mode of the electronic device, a multiply and accumulate (MAC) array configured to include a plurality of MAC units, and at least one processor configured to include a zero weight skip unit for confirming a first weight having a value of ‘0’ among weights related with input data, and for forwarding a second weight not having a value of ‘0’ among the weights, to the MAC array. The at least one processor is configured to acquire the input data, acquire the weights, select the mode of the electronic device by using the switch, in response to a first mode of the electronic device being selected, perform convolution operations between the input data and the second weight forwarded to the MAC array through the zero weight skip unit, and, in response to a second mode of the electronic device being selected, perform convolution operations between the input data and the weights forwarded to the MAC array.