An electronic device and a method for controlling are provided. The electronic device may include a memory storing first input data and first weight data used in operations of a neural network model and a processor configured to input the first input data and the first weight data into a first module, and acquire second input data and second weight data, where a part of the first input data is truncated, and where a part of the first weight data is truncated, input the second input data and the second weight data into a second module that performs multiplication operations, and acquire first output data, and based on scaling factors of the first input data and first weight data identified through the first module, convert the acquired first output data into a floating point form expressing a first bit as a unit scale and acquire second output data.