Disclosed herein is convolutional neural network (CNN) system for generating a classification for an input image. According to an embodiment, the CNN system comprises a sequence of neural network layers configured to: derive a feature map based on at least the input image; puncture at least one selection among the feature map and a kernel by setting the value of one or more elements of a row of the at least one selection to zero according to a pattern and cyclic shifting the pattern by a predetermined interval per row to set the value of one or more elements of the rest of the rows of the at least one selection according to the cyclic shifted pattern; convolve the feature map with the kernel to generate a first convolved output; and generate the classification for the input image based on at least the first convolved output.