A processor-implemented method of performing a convolution operation is provided. The method includes obtaining input feature map data and kernel data, determine the kernel data based on a number of input channels of the input feature map, a number of output channels of an output feature map, and a number of groups of the input feature map data and a number of groups of the kernel data related to the convolution operation, and performing the convolution operation based on the input feature map data and the determined kernel data.