Convolutional neural network based computational imaging spectroscopy

Chenning Tao; Xiao Shu; Wentao Zhang; Xiao Tao; Chang Wang; Zhenrong Zheng

doi:10.1117/12.2319646

17 September 2018 Convolutional neural network based computational imaging spectroscopy

Chenning Tao, Xiao Shu, Wentao Zhang, Xiao Tao, Chang Wang, Zhenrong Zheng

Proceedings Volume 10752, Applications of Digital Image Processing XLI; 107521T (2018) https://doi.org/10.1117/12.2319646
Event: SPIE Optical Engineering + Applications, 2018, San Diego, California, United States

Abstract

Computational imaging spectrometry provides spatial-spectral information of objects. This technology has been applied in biomedical imaging, ocean monitoring, military and geographical object identification, etc. Via compressive sensing with coded apertures, 3D spatial-spectral data cube of hyperspectral image is compressed into 2D data array to alleviate the problems due to huge amounts of data. In this paper, a 3D convolutional neural network (3D CNN) is proposed for reconstruction of compressively sensed (CS) multispectral image. This network takes the 2D compressed data as the input and gives an intermediate output, which has identical size with the original 3D data. Then a general image denoiser is applied on it to obtain the final reconstruction result. The network with one fully connected layer, six 3D convolutional layers is trained with a standard hyperspectral image dataset. Though the compression rate is extremely high (16:1), this network performs well both in spectral reconstruction, demonstrated with single point spectrum, and in quantitative comparison with original data, in terms of peak signal to noise ratio (PSNR). Compared with state-of-the-art iterative reconstruction methods e.g. two-step iterative shrinkage/thresholding (TwIST), this network features high speed reconstruction and low spectral dispersion, which potentially guarantees more accurate identification of objects.

Conference Presentation

Citation Download Citation

Chenning Tao, Xiao Shu, Wentao Zhang, Xiao Tao, Chang Wang, and Zhenrong Zheng "Convolutional neural network based computational imaging spectroscopy", Proc. SPIE 10752, Applications of Digital Image Processing XLI, 107521T (17 September 2018); https://doi.org/10.1117/12.2319646

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available