PulseNetOne: Fast unsupervised pruning of convolutional neural networks for remote sensing

Thumbnail Image
remotesensing-12-01092-v2.pdf(568.53 KB)
Published version
Browne, David
Giering, Michael
Prestwich, Steven D.
Journal Title
Journal ISSN
Volume Title
Published Version
Research Projects
Organizational Units
Journal Issue
Scene classification is an important aspect of image/video understanding and segmentation. However, remote-sensing scene classification is a challenging image recognition task, partly due to the limited training data, which causes deep-learning Convolutional Neural Networks (CNNs) to overfit. Another difficulty is that images often have very different scales and orientation (viewing angle). Yet another is that the resulting networks may be very large, again making them prone to overfitting and unsuitable for deployment on memory- and energy-limited devices. We propose an efficient deep-learning approach to tackle these problems. We use transfer learning to compensate for the lack of data, and data augmentation to tackle varying scale and orientation. To reduce network size, we use a novel unsupervised learning approach based on k-means clustering, applied to all parts of the network: most network reduction methods use computationally expensive supervised learning methods, and apply only to the convolutional or fully connected layers, but not both. In experiments, we set new standards in classification accuracy on four remote-sensing and two scene-recognition image datasets.
Convolutional Neural Network , Network compression , Pre-trained AlexNet , Pre-trained VGG16 , Pruning networks , Remote-sensing image classification , Transfer learning
Browne, D., Giering, M. and Prestwich, S. (2020) 'PulseNetOne: Fast Unsupervised Pruning of Convolutional Neural Networks for Remote Sensing', Remote Sensing, 12(7), 1092 (23 pp). doi: 10.3390/rs12071092