Feature fusion with deep supervision for remote-sensing image scene classification

The convolutional neural networks (CNNs) have shown an intrinsic ability to automatically extract high level representations for image classification, but there is a major hurdle to their deployment in the remote-sensing domain because of a relative lack of training data. Moreover, traditional fusion methods use either low-level features or score-based fusion to fuse the features. In order to address the aforementioned issues, we employed a deep supervision (DS) strategy to enhance the generalization performance in the intermediate layers of the AlexNet model for remote-sensing image scene classification. The proposed DS strategy not only prevents from overfitting, but also extracts the features more transparently. Secondly, the canonical correlation analysis (CCA) is adopted as a feature fusion strategy to further refine the features with more discriminative power. The fused AlexNet features achieved by the proposed framework have much higher discrimination than the pure features. Extensive experiments on two challenging datasets: 1) UC MERCED data set and 2) WHU-RS dataset demonstrate that the two proposed approaches both enhance the performance of the original AlexNet architecture, and also outperform several state-of-the-art methods currently in use.

Authors:
Muhammad Usman, Wang Weiqiang, Hadid Abdenour

Publication type:
A4 Article in conference proceedings

Place of publication:
30th International Conference on Tools with Artificial Intelligence, ICTAI 2018

Keywords:
Canonical Correlation Analysis(CCA), Deep Supervision (DS), Pre-trained AlexNet, Scene Classification

Published:

Full citation:
U. Muhammad, W. Wang and A. Hadid, “Feature Fusion with Deep Supervision for Remote-Sensing Image Scene Classification,” 2018 IEEE 30th International Conference on Tools with Artificial Intelligence (ICTAI), Volos, 2018, pp. 249-253, https://doi.org/10.1109/ICTAI.2018.00046

DOI:
https://doi.org/10.1109/ICTAI.2018.00046

Read the publication here:
http://urn.fi/urn:nbn:fi-fe2020042822713