Paper
13 June 2024 Efficient MLP-aided CNN network with local-global feature fusion for hyperspectral image classification
Fei Du, Meng Li, Ju Li, Xiaoxin An, Xinan Xu, Cuiping Gao, Guodong Han
Author Affiliations +
Proceedings Volume 13180, International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2024); 131800O (2024) https://doi.org/10.1117/12.3034144
Event: International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2024), 2024, Guangzhou, China
Abstract
The utilization of long-range spatial features has significantly enhanced hyperspectral image (HSI) classification performance. However, capturing global spatial relationships among pixels comes with a high computational expense. Given that super-pixels are created adaptively from the content within hyperspectral images, leveraging them for global spatial information extraction has proven to be an efficient strategy. Nevertheless, some methodologies at the super-pixel level, like Graph Convolutional Networks (GCN), are burdened by numerous parameters and substantial computational complexity. In order to address these challenges, this paper introduces an Efficient MLP-Aided CNN Network with Localglobal Feature Fusion for Hyperspectral Image Classification (EMACN). EMACN adopts a dual-branch structure, utilizing a super-pixel-based Multilayer Perceptron (MLP) for global feature extraction with a pixel-based Convolutional Neural Network (CNN) for local feature extraction, thereby achieving an effective balance between computational efficiency and classification performance. Compared to the quadratic complexity seen in other super-pixel level deep learning structures such as GCNs, the computational complexity of our super-pixel-based MLP approach is linear with respect to both the number and dimensionality of super-pixels. Furthermore, we enhance our model by integrating a spectral transformation subnet that utilizes group convolution instead of the traditional 1x1 convolution for reducing the dimensionality of hyperspectral images. Additionally, our model incorporates a pixel-based CNN module that employs 2D depthwise separable convolutions, optimizing computational efficiency. This design allows our network to achieve an optimal balance between its representation capabilities and computational expenses. Extensive testing across three datasets confirms the superior performance of our proposed network.
(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Fei Du, Meng Li, Ju Li, Xiaoxin An, Xinan Xu, Cuiping Gao, and Guodong Han "Efficient MLP-aided CNN network with local-global feature fusion for hyperspectral image classification", Proc. SPIE 13180, International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2024), 131800O (13 June 2024); https://doi.org/10.1117/12.3034144
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Convolution

Hyperspectral imaging

Image classification

Feature fusion

Feature extraction

Machine learning

Education and training

Back to Top