Skip to yearly menu bar Skip to main content


Poster

Frequency-Domain Dynamic Pruning for Convolutional Neural Networks

Zhenhua Liu · Jizheng Xu · Xiulian Peng · Ruiqin Xiong

Room 210 #67

Keywords: [ Efficient Inference Methods ] [ CNN Architectures ]


Abstract:

Deep convolutional neural networks have demonstrated their powerfulness in a variety of applications. However, the storage and computational requirements have largely restricted their further extensions on mobile devices. Recently, pruning of unimportant parameters has been used for both network compression and acceleration. Considering that there are spatial redundancy within most filters in a CNN, we propose a frequency-domain dynamic pruning scheme to exploit the spatial correlations. The frequency-domain coefficients are pruned dynamically in each iteration and different frequency bands are pruned discriminatively, given their different importance on accuracy. Experimental results demonstrate that the proposed scheme can outperform previous spatial-domain counterparts by a large margin. Specifically, it can achieve a compression ratio of 8.4x and a theoretical inference speed-up of 9.2x for ResNet-110, while the accuracy is even better than the reference model on CIFAR-110.

Live content is unavailable. Log in and register to view live content