|
Optical coherence tomography (OCT) is a kind of noninvasive high-resolution biomedical imaging technology based on low coherence interferometry. The principle behind OCT imaging leads to presence of speckle in the OCT images. Because speckle carries both a noise component and structural information about the imaged object, it is very challenging to suppress speckle noise effectively. Various algorithms have been proposed to despeckle OCT images. The two classes of state-of-the-art despeckling methods are wavelet-, curvelet-, or contourlet-based methods1–4 and anisotropic diffusion-based methods.5,6 These methods tend to provide limited speckle noise suppression or reduce the sharpness of structural details in the case of high speckle noise corruption. Recently, a nonlocal means (NLM) method7 has been proposed, which explores image self-similarities by the nonlocal comparison of image patches for image denoising. The NLM method, originally designed for Gaussian noise removal, has lately been applied to remove speckle noise from ultrasound images8 and synthetic aperture radar images.9 This paper aims to extend this method to restore OCT images. However, the NLM method measures the similarity between pixels based on the intensities of image patches only in the translational sense without considering the orientation of each patch. Therefore, it is difficult for this method to preserve intricate details of speckled OCT images involving rotated similar patterns. To address this problem, the spiking cortical model (SCM) proposed in Ref. 10 is introduced into the NLM method to despeckle OCT images by exploring rotation-invariant self-similarities of speckled images. Derived from several other visual cortices, the SCM is a laterally connected two-dimensional neural network. When the SCM is used for image processing, each network neuron corresponds to an input image pixel. The neuron at () in the SCM receives the corresponding pixel’s normalized intensity as an external stimulus and receives local stimuli from its neighboring neurons. When the combined external and local stimuli , the internal activity, exceeds a dynamic threshold , will fire and generate a pulse output . In the ’th iteration, these variables are computed as10 where and are constants and is a large constant for adjustment of the threshold magnitude; is the connection weight between the neuron and its linking neuron , and it is defined as if or otherwise . Equation (1) means that the pulse output of a neuron modulates the activity of its neighbors via the connection weight. Equation (2) shows that the pulse output of will be fed back to modulate its dynamic threshold. Based on iterative computations, the SCM will produce a series of binary pulse images by Eq. (3). Since pulse images contain information of an input image, they can be used for feature generation. The entropy of pulse outputs has been utilized for image feature extraction.10 Because the Tsallis entropy is suitable for measuring the information contained in the neurons,11 it is computed for pulse images to extract the features from image patches in in this paper.Let be the similarity window centered at () in . The probabilities and of 1’s and 0’s in are computed as the ratio of the number of firing pixels and that of nonfiring ones to the sum of pixels in , respectively. The Tsallis entropy is calculated by , where is an adjustable parameter chosen as according to Ref. 11. The Tsallis entropy from the various iterations will form the feature vector of the image patch centered at () in , i.e., , where denotes the maximum iteration times. For two rotated repetitive patterns in , their pulse images generated by the SCM will have the same number of firing pixels at each iteration, thereby leading to the same Tsallis entropy. It follows that is rotation-invariant. By introducing into the comparison of image patches, the SCM-based NLM (SNLM) method can represent rotation-invariant self-similarities of OCT images effectively. Accordingly, the similarity between two pixels at and () in is defined as where denotes the decay parameter and is the Euclidean norm. In Eq. (4), the pixel similarity is defined as a piecewise function in order to ensure good image restoration performance by dismissing highly dissimilar image patches from the similarity computation.Based on , the denoised intensity of the pixel at () in is defined as where means the search window centered at () in .To verify the advantage of the SNLM method in determining image self-similarities over the NLM method, simulations have been done on the synthetical noise-free image [Fig. 1(a)] and the corresponding speckled image [Fig. 1(d)]. The weight denoting the similarity between the center pixel in the red box and other pixels in each of the two images is computed for the two compared methods using the similarity window. The distribution of weights is shown in Figs. 1(b), 1(c), 1(e), and 1(f). It is shown that the NLM method can find only the pixels with neighborhoods similar to the center pixel up to translation. However, the SNLM method can identify the pixels whose neighborhoods are similar to that of the center pixel up to both translation and rotation with good robustness to noise. The above comparison indicates that the SNLM method can represent self-similarities of speckled images more effectively than the NLM method. To demonstrate the superiority of the SNLM method in denoising OCT images, the NLM method and the modified nonlinear complex diffusion filter (MNCDF)6 have been used for comparisons. Experiments have been done on the three retinal OCT images [Figs. 2(a), 3(a), and 3(e)] of size pixels corresponding to . These images have been acquired using Cirrus HD-OCT system model 4000. In the experiments, the parameters in the MNCDF are chosen as suggested in Ref. 6. The SNLM method is insensitive to SCM parameters, and thus, we fix , , , and . Meanwhile, we have chosen the similarity window () and the search window () for the NLM and SNLM methods while tuning the decay parameter in the two methods to obtain good restoration results. The quantitative comparisons of restoration performance are made among the three despeckling methods operating on Fig. 2(a) acquired from the patient with macular hole. Because the noise-free OCT image is unknown, four quality metrics are chosen for evaluating restoration performance, i.e., signal-to-noise ratio (SNR), average contrast-to-noise ratio (CNR),1 average equivalent number of looks (ENL),1 and cross-correlation (XCOR).3 Both the SNR and CNR are computed using log scale data, while the ENL and XCOR are calculated using linear scale data. Table 1 lists the four metrics for the retinal OCT image, the images restored by the MNCDF, the NLM method with the decay parameter chosen as 70, and the SNLM method using with an interval of 0.05. Here, the SNR is computed on the background region (the box labeled 1). The CNR is averaged over the six regions (boxes labeled 2 to 7). The ENL is averaged over the three homogeneous regions (boxes labeled 2 to 4). We can see from Table 1 that the trade-off between speckle attenuation and similarity degradation is controlled by a single parameter . In general, the increasing will lead to improved speckle reduction performance, but poorer detail preservation performance. Based on the comprehensive consideration of four metrics, we have chosen for despeckling the OCT image. Table 1 shows that the SNLM method using provides significant SNR, CNR, and ENL improvements over other methods. Compared with the original image, the SNLM method improves the SNR by 16.5 dB, the CNR by 7.53 dB, and the ENL by a factor of times with a small similarity reduction of 5.4%. Meanwhile, the proposed method outperforms the NLM method by providing slightly higher XCOR as well as SNR, CNR, and ENL improvements by 1.51 dB, 0.58 dB, and 1.55 times, respectively. Table 1Image quality metrics.
Note: SNR, signal-to-noise ratio; CNR, contrast-to-noise ratio; ENL, equivalent number of looks; XCOR, cross-correlation; NLM, nonlocal means; MNCDF, modified nonlinear complex diffusion filter; SNLM, spiking cortical model–based NLM. Figure 2 shows the retinal OCT image, the restored images, the enlarged views of the region of interest marked with the white box, and the corresponding regions despeckled by the three compared methods. We can see from Fig. 2 that the MNCDF cannot deliver sufficient speckle suppression and causes blurring of image details due to oversmoothing. The NLM method can suppress speckle noise effectively, but it damages some important image details as indicated by three white boxes in Fig. 2(g). By comparison, the SNLM method provides effective speckle reduction in the background region dominated by speckle noise as well as other regions where noise is superimposed on the signals. Furthermore, comparisons of the enlarged views further demonstrate that the SNLM method not only maintains the edge sharpness of the original signals very well, but also significantly improves the contrast and the visibility of image features, which will facilitate quantitative analysis of OCT images. To demonstrate the generalization of the SNLM method, Fig. 3 shows the restoration results for three despeckling methods operating on other two OCT images. Likewise, the visual comparisons show that the proposed method performs significantly better than the two compared methods in terms of speckle reduction and edge preservation. As regards the computational efficiency of the SNLM method, its mean runtime for three OCT images is , nearly four times that of the NLM method, when implemented using Visual C++6.0 on an Intel Dual Core 2.4-GHz processor with 4.0 GB of RAM. In conclusion, the SNLM method provides a novel means for reducing speckle noise in OCT images by exploring rotation-invariant self-similarities of noisy images with good noise immunity. Experimentally, it has been shown that the SNLM method can restore OCT images effectively in terms of both objective criteria (SNR, CNR, ENL, and XCOR) and subjective human vision. We anticipate that this method can be utilized in a wide range of medical fields, such as ophthalmology, dermatology, gastroenterology, dentistry, and intraarterial imaging. AcknowledgmentsThe authors are grateful to Professor Andrzej Zajac and Professor Jan Kasprzak from Medical University of Warsaw for providing retinal optical coherence tomography images. This work is supported by the Project of the National 12th-Five Year Research Program of China (Grant No. 2012BAI13B02). ReferencesD. C. Adler, T. H. Ko and J. G. Fujimoto,
“Speckle reduction in optical coherence tomography images by use of a spatially adaptive wavelet filter,”
Opt. Lett., 29
(24), 2878
–2880
(2004). http://dx.doi.org/10.1364/OL.29.002878 OPLEDP 0146-9592 Google Scholar
J. Xu et al.,
“Wavelet domain compounding for speckle reduction in optical coherence tomography,”
J. Biomed. Opt., 18
(9), 096002
(2013). http://dx.doi.org/10.1117/1.JBO.18.9.096002 JBOPFO 1083-3668 Google Scholar
Z. Jian et al.,
“Speckle attenuation in optical coherence tomography by curvelet shrinkage,”
Opt. Lett., 34
(10), 1516
–1518
(2009). http://dx.doi.org/10.1364/OL.34.001516 OPLEDP 0146-9592 Google Scholar
J. Xu et al.,
“Speckle reduction of retinal optical coherence tomography based on contourlet shrinkage,”
Opt. Lett., 38
(15), 2900
–2903
(2013). http://dx.doi.org/10.1364/OL.38.002900 OPLEDP 0146-9592 Google Scholar
P. Puvanathasan and K. Bizheva,
“Interval type-II fuzzy anisotropic diffusion algorithm for speckle noise reduction in optical coherence tomography images,”
Opt. Express, 17
(2), 733
–746
(2009). http://dx.doi.org/10.1364/OE.17.000733 OPEXFF 1094-4087 Google Scholar
R. Bernardes et al.,
“Improved adaptive complex diffusion despeckling filter,”
Opt. Express, 18
(23), 24048
–24059
(2010). http://dx.doi.org/10.1364/OE.18.024048 OPEXFF 1094-4087 Google Scholar
A. Buades, B. Coll and J. M. Morel,
“A review of image denoising algorithms, with a new one,”
Multi. Model. Simul., 4
(2), 490
–530
(2005). http://dx.doi.org/10.1137/040616024 MMSUBT 1540-3459 Google Scholar
P. Coupé et al.,
“Nonlocal means-based speckle filtering for ultrasound images,”
IEEE Trans. Image Process., 18
(10), 2221
–2229
(2009). http://dx.doi.org/10.1109/TIP.2009.2024064 IIPRE4 1057-7149 Google Scholar
L. Torres et al.,
“Speckle reduction in polarimetric SAR imagery with stochastic distances and nonlocal means,”
Pattern Recognit., 47
(1), 141
–157
(2014). http://dx.doi.org/10.1016/j.patcog.2013.04.001 PTNRA8 0031-3203 Google Scholar
K. Zhan, H. Zhang and Y. Ma,
“New spiking cortical model for invariant texture retrieval and image processing,”
IEEE Trans. Neural Netw., 20
(12), 1980
–1986
(2009). http://dx.doi.org/10.1109/TNN.2009.2030585 ITNNEP 1045-9227 Google Scholar
R. Sneddon,
“The Tsallis entropy of natural information,”
Phys. A, 386
(1), 101
–118
(2007). http://dx.doi.org/10.1016/j.physa.2007.05.065 PHYADX 0378-4371 Google Scholar
|