Research Papers: Imaging

Estimation of multiexponential fluorescence decay parameters using compressive sensing

[+] Author Affiliations
Sejung Yang

Ewha Womans University Medical Center, Institute of Convergence Medicine, 1071, Anyangcheon-ro, Yangcheon-gu, Seoul 158-710, Republic of Korea

Joohyun Lee, Byung-Uk Lee

Ewha Womans University, Department of Electronics Engineering, 52 Ewhayeodae-gil, Seodaemun-gu, Seoul 120-750, Republic of Korea

Youmin Lee, Minyung Lee

Ewha Womans University, Department of Chemistry and Nanoscience, 52 Ewhayeodae-gil, Seodaemun-gu, Seoul 120-750, Republic of Korea

J. Biomed. Opt. 20(9), 096003 (Sep 03, 2015). doi:10.1117/1.JBO.20.9.096003
History: Received March 23, 2015; Accepted August 5, 2015
Text Size: A A A

Open Access Open Access

Abstract.  Fluorescence lifetime imaging microscopy (FLIM) is a microscopic imaging technique to present an image of fluorophore lifetimes. It circumvents the problems of typical imaging methods such as intensity attenuation from depth since a lifetime is independent of the excitation intensity or fluorophore concentration. The lifetime is estimated from the time sequence of photon counts observed with signal-dependent noise, which has a Poisson distribution. Conventional methods usually estimate single or biexponential decay parameters. However, a lifetime component has a distribution or width, because the lifetime depends on macromolecular conformation or inhomogeneity. We present a novel algorithm based on a sparse representation which can estimate the distribution of lifetime. We verify the enhanced performance through simulations and experiments.

Figures in this Article

Fluorescence lifetime imaging microscopy (FLIM) is an imaging technique observing the decreasing rate of emitted photon counts with the lapse of time, after applying a laser beam to a cell which is labeled with fluorophores. It provides essential information for cell analysis and can be used for intracellular measurements of fluorescence resonance energy transfer (FRET).1 The FLIM acquisition methods can be categorized into time-domain and frequency-domain methods. Time-domain methods, such as time correlated single-photon counting (TCSPC) techniques, are more robust to scattering and can measure short lifetimes better than frequency-domain methods.2,3 FLIM can be obtained using analog mean delay, which is intensity weighted mean delay time; however, it cannot estimate multiple lifetimes; it measures the intensity weighted average lifetime.4 Recently, many researchers have used FLIM with multiphoton confocal microscopy to noninvasively monitor changes in metabolism. Skala et al. have observed cellular nicotinamide adenine dinucleotide and flavin adenine dinucleotide lifetimes at the earliest stages of cancer development.5 Roberts et al. have investigated coexisting drugs and their metabolites in the skin using FLIM techniques.6 Deka et al. have also used FLIM to measure the metabolic rate of cells for in vivo wound healing diagnosis.7

Accurate estimation of fluorescence lifetime is crucial to the FLIM imaging. A simple estimation method is a nonlinear least-squares (NLLS) fitting. The NLLS algorithm is a conventional method to estimate lifetimes by minimizing the weighted sum of the squared residuals.811 However, this method is not effective in low counts, since it does not adopt a Poisson noise probability density function of the photon counting process. FRET has donor and acceptor fluorophores; however, NLLS does not accurately estimate multiexponential decays. Pearson and Neyman’s χ2-based estimators have been proposed to overcome the Gaussian noise assumption.12 Sasaki and Masuhara proposed a convolved autoregressive model for fitting multiexponential decay curves.13 Apanasovich and Novikov also proposed a fitting method, which is mathematically equivalent to Sasaki’s and Masuhara method.14 An improved version was presented by Enderlein and Erdmann, which estimates the optimal fit parameters for multiexponential decay curves by examining an error function.15

Recently, the maximum-likelihood estimator (MLE) based on the Poisson-likelihood function has proven to be superior in terms of unbiasedness and efficiency from theoretical analysis and computer simulations.16 Although MLE is an excellent estimator to fit the multiexponential decay parameters, it is sensitive to the initial parameter values. Thus, the choice of the numerical optimization algorithm is significantly important.

The number of fluorescent lifetime components is quite sparse; therefore, a compressed sensing algorithm is suitable for the estimation. We observed that a sparse Poisson intensity reconstruction algorithm (SPIRAL),17 which is a penalized maximum Poisson-likelihood estimator, is effective for FLIM. SPIRAL has been proposed for the estimation of image intensity from limited photon counts such as tomographic reconstruction in nuclear medicine. Using this algorithm, a unique solution to the minimization can be obtained.

This paper proposes a novel algorithm for multiexponential fluorescence decay parameters that can estimate distribution of the lifetime in FLIM. To the best of our knowledge, compressed sensing has not been applied to FLIM yet. We evaluate the performance of our algorithm from simulations and TCSPC data from confocal microscopy, which suffer from very low photon counts. Experimental results demonstrate the efficacy of the proposed approach.

Before proposing a new method for estimating lifetime based on a Poisson distribution with a regularizing function, a brief review of prior work for conventional lifetime estimation is provided. We especially discuss two approaches: modified Neyman’s nonlinear least squares (MN-NLLS) and fast fitting, which are embedded in the widely used TCSPC software and SPCImage.18

Modified Neyman’s Nonlinear Least-Squares Method

NLLS algorithm is used in over-determined systems and this algorithm gives the solution that minimizes the sum of squared error, which is the difference between the observed data y=[y1,y2,,yN]T and the fitting model g=[g(t1),g(t2),,g(tN)]T.810 The objective function is as follows: Display Formula

ΦNLLS=i=1N[g(ti)yi]2.(1)

The NLLS algorithm is a widely used method to obtain the distribution of fluorescence lifetime, since it is simple and fast. However, NLLS assumes that the measured data are acquired under additive Gaussian noise with equal variance. It is not suitable for photon counts which follow a Poisson distribution. Thus, it is less accurate for fluorescence lifetime estimation, as demonstrated by Kim and Seok.16

Neyman’s χ2 function has been introduced using the property of the Poisson process; therefore, the variance is proportional to the intensity. However, the original Neyman’s χ2 function is not defined when yi is zero.16 As a remedy, a modified Neyman’s NLLS method is proposed, which is obtained by substituting the variance in the denominator with max(yi,1). This objective function can be written as Display Formula

ΦMN-NLLS=i=1N[g(ti)yi]2max(yi,1).(2)

Observation of multiexponential decay is modeled as Display Formula

g(ti)=[j=1Mfjexp(ti/τj)]*hi,(3)
where f=[f1,f2,,fM]T is the amplitude of each lifetime component corresponding to τ=[τ1,τ2,,τM], and hi stands for the instrument response function h(ti). The observation model vector g can be represented as Af, where the matrix A consists of the convolution of the exponential decay functions with each lifetime component τ=[τ1,τ2,,τM] at measurement time t=[t1,t2,,tN], Display Formula
A=[hi*[exp(t1/τ1)exp(tN/τ1)]hi*[exp(t1/τM)exp(tN/τM)]]T.(4)

Fast Fitting Using a Convolved Autoregressive Model

For estimating the decay parameters of photon emission curves convolved with an instrumental response function, a convolved autoregressive model was proposed.1315 The discrete number of photons observed in a finite number of time channels [tjΔt/2,tj+Δt/2] is given by Display Formula

yk=i=0j=1Mfjexp(iΔt/τj)hki,(5)
where τj and fj are the decay constant and the amplitude of the j’th component decay. yk is the number of observed photon counts, and hk is the instrumental impulse response function for the k’th time channel. The z-transform of Eq. (5) yields Display Formula
y˜(z)=j=1Mfjh˜(z)(1zj/z)1,(6)
where zj=exp(Δt/τj) and h˜(z) is the z transform of the estimated instrumental impulse response function hk.

Equation (6) can be rearranged as follows: Display Formula

y˜(z)j=1M(1zj/z)=j=1Mfjh˜(z)ijM(1zi/z).(7)

The products can be expanded into sums by defining new coefficients bj and cj: Display Formula

j=1M(1zj/z)=1j=1Mbjzj,j=1MfjijM(1zi/z)=j=0M1cjzj.(8)

After rearranging and expanding, Eq. (6) can be rewritten in the following form: Display Formula

y˜(z)=j=1My˜(z)bjzj+j=0M1h˜(z)cjzj.(9)

The inverse z-transform gives the desired autoregressive convolution: Display Formula

yk=j=1Mbjykj+j=0M1cjhkj.(10)

It can be written in a compact matrix form. Display Formula

y=Dp,withy=[yM+1,yM+2,,yN]T,p=[b1,b2,,bM,c0,c1,,cM1]T,D=[yMyM1y1yM+1yMy2yN1yN2yNMhM+1hMh2hM+2hM+1h3hnhN1hNM+1],(11)
where N is the number of time sampled data points and M is the number of lifetime components.

The general form of Eq. (11) is as follows: Display Formula

y=Dp+ϵ,(12)
where ϵ is a random vector of residuals. The optimal values for the vectors p and y can be estimated. Display Formula
y^=Dp^,(13)
where y^ and p^ are the estimated versions of y and p, respectively. From this notation, we have ϵ=yy^. The covariance matrix of the vector ϵ is Display Formula
cov(ϵ)=(ϵϵ)(ϵϵ)T=V,(14)
where ϵ denotes the expectation of ϵ. The MLE solution p is given by Display Formula
p=(DTV1D)1DTV1y,(15)
which enables the calculation of the distribution of multiexponential components fj from Eq. (8).

Problem Formulation

Data collected by counting photons hitting a detector are inherently noisy due to low count levels. Harmany et al. developed SPIRAL for photon limited imaging in the spatial domain such as emission tomography.17 The algorithm is reported to outperform the state-of-the-art emission tomography algorithms. We found that SPIRAL can be adopted for multiexponential lifetime estimation in the time domain. Under a Poisson process, the observation is modeled as Display Formula

yPoisson(Af*),(16)
where f*=[f1*,f2*,,fM*] is the amplitude of fluorescence lifetimes to be estimated, the matrix A is given in Eq. (3), and y is a length N vector of the observed photon counts; f* and A represented the image intensity and a projection matrix for measurements, respectively, in the original SPIRAL.17

Poisson Log-Likelihood

The sensing matrix A represents multiexponential decay in FLIM: each column represents an exponential decay of a single lifetime component, while the row direction is the time axis. Thus, the observed photon count is modeled as a linear superposition of sparse lifetime components f*. In addition, we need to include the effect of impulse response function of the microscopy. Therefore, the sensing matrix A is the same as Eq. (3).

In the Poisson model, the probability of the observation vector is given by Display Formula

p(y|Af)=Πi=1N(eiTAf*)yiyi!exp(eiTAf*),(17)
where ei is the i’th canonical basis unit vector. Therefore, the negative Poisson log-likelihood is given by Display Formula
log[p(y|Af)]=log[Πi=1N(eiTAf)yiyi!exp(eiTAf)]=1TAfi=1Nlog(eiTAf)yiyi!,(18)
where 1 is an n-vector of ones. Since yi is the constant with respect to f, we can ignore the log(yi!) term during optimization. A small parameter β=1010 is added to avoid the singularity problem of a log function when f is zero. The maximum-likelihood estimation for the measurement modeled in Eq. (16) is determined by the minimizing the following equation: Display Formula
F(f)=1TAfi=1Nyilog(eiTAf+β).(19)

Objective Function

We use an objective function which is a sum of the negative Poisson log-likelihood function and L1-norm regularization term. By adding the L1-norm penalty term to the objective function, we can obtain a sparse solution f*.17,1923 Exponential decay of the fluorescence can be modeled as a sum of a finite number of lifetime components; therefore, sparse representation is an excellent choice.

Function F(f) is the negative Poisson log-likelihood function of the observed photon counts y from the Poisson process. We adopt a penalized negative Poisson log-likelihood objective function with a non-negativity constraint: Display Formula

Φ(f)=F(f)+ωf1f*=argminΦ(f),subject tof0,(20)
where ω is the weighting factor for the regularization term. A sequential quadratic approximation to F(f) is employed for SPIRAL, and the global convergence and uniqueness of the solution are established under a mild set of assumptions.17

The SPIRAL solves the penalized Poisson log-likelihood function; therefore, it can find multiple exponential decay time constants and amplitudes that are sparse and non-negative.

To validate the proposed algorithm, a simulation study is conducted in order to estimate multifluorescence lifetimes and to compare these results to existing methods. A biexponential decay model for a simulation is as follows: Display Formula

yi=[a1exp(tiτ1)+a2exp(tiτ2)]*hi,(21)
where a and τ denote the photon count and lifetime, respectively.

The simulation uses two fluorescence components with lifetimes of 2 and 6 ns. To adjust the Poisson noise variance, we employed a scaling factor α: Display Formula

x=Poisson{αy}.(22)

The variance and mean are proportional to α; therefore, signal power is proportional to α2, while the signal-to-noise power ratio is proportional to α. As α decreases, the signal-to-noise ratio decreases with α. The observed time interval is from 0 to 19.1 ns and the sampling interval is 0.1 ns. The number of lifetime components for sensing matrix A is 196, which covers from 32 ps to 32 ns in logscale. Since the conventional MLE is sensitive to initial values, we set the initial parameter values to the true values, while the initial values are set to zero for other methods. Conventional methods need to fix the number of lifetime components; therefore, they find the best fit after increasing the lifetime component from one to three in most cases. On the other hand, we obtain the distribution of lifetime components using the proposed algorithm. From the distribution, the lifetime is estimated as the amplitude weighted mean of the distribution in each contiguous group and the corresponding intensity is the sum of the intensity components of the group.

Table 1 shows the simulation results of lifetime estimation using the MN-NLLS method,810 fast fitting method,15 MLE method initialized with ground truth,16 and our algorithm. Mean and standard deviation are as shown in Table 1 as calculated from 500 realizations of the Poisson random variable. The accuracy of algorithms decreases as the scaling Poisson variance factor α decreases. As shown in Table 1, the MN-NLLS and fast fitting methods are quite sensitive to noise: the estimated mean value significantly deviates from true lifetime, especially when α=0.2. In comparison, the proposed method is robust to noise: the relative error for the 2 ns component is 33%, 37.5%, 7%, and 7.5% for NM-NLLS, fast fitting, MLE, and the proposed method. The proposed method provides similar results the as MLE method initialized with the ground truth, since the proposed algorithm is based on MLE. However, the MLE method is not practical since the initial solution must be the ground truth. Otherwise, it falls in a local minimum, which is quite different from the desired solution.

Table Grahic Jump Location
Table 1Simulation results of fluorescence lifetime estimation using modified Neyman’s nonlinear least squares (MN-NLLS) algorithm,12 fast fitting,15 maximum-likelihood method,16 and our algorithm (true values of lifetimes: 2, 6 ns and true values of amplitudes: 100, 100).

Typical execution times of various estimation methods in Table 1 are approximately as follows: MN-NLLS method 0.41 s, fast fitting method 0.72 s, maximum-likelihood method 2.10 s, and the proposed method 1.25 s. The compared algorithms were implemented by MATLAB®. The execution times were obtained with an Intel Core i7-3770 processor running at 3.40 GHz.

Lifetime depends on the macromolecular conformation and also heterogeneity; therefore, the lifetime component has a distribution or width depending on the conformation. Since the proposed method can estimate the distribution of the lifetime, it results in a more accurate estimation for cell where the number of lifetime components is not known.

We compare the estimated lifetime of MN-NLLS and fast fitting algorithms to that of the proposed algorithm with FLIM data. A Nikon TE2000-S microscope and Picoquant LDH-P-C-440M laser were used for FLIM imaging. The laser operates at a wavelength of 442 nm and a repetition rate of 20 MHz. A lens for the microscope has a numerical aperture 1.4, 60×. The FLIM image scanner is atomic force microscopy controller by PSIA and the fluorometric detector is the R3809U-07 model by Hamamatsu Photonics. A SPC-830 board by Becker-Hickl is used for data processing. A 473-nm long path cut-off filter (Semrock) was used in front of the detector to block the excitation beam. Photon counts were continuously monitored by a photon counter (EG&G Ortec). The thin film containing dihexyloxacarbocyanine iodide (DOCI) and Coumarin 343 dyes were prepared on a cover glass by the spin-coating method. FITC- Aβ11-25 and FITC- Aβ11-25-DABMI to the HeLa cells were incubated for 20 h.

First, we compare the resolving capabilities with a double exponential decay: we coated a mixture of DOCI and Coumarin 343, whose measured lifetimes are 1.59 and 2.82 ns respectively, on polyacrylic acid polymer. As a measure of quality, we use Neyman’s χ2, defined as Display Formula

χ2=1Npi=1N(yigi)2yi,(23)
for yi larger than a threshold. In our experiments, the threshold is set to 5. The numbers of the fit parameters and data points are p and N. The lifetime estimation is accurate when χ2 is close to one.

To experiment with the biexponential decay, we mixed DOCI and Coumarin 343, which have different lifetimes. TCSPC collected data were analyzed with MN-NLLS, the fast fitting method, and the proposed algorithm, and results are summarized in Table 2. We selected six image positions for brevity: the rest of the image is quite similar to the shown data. The proposed method can more accurately estimate double exponential fluorescence lifetimes than others. The MN-NLLS method estimated double exponential components at two positions among the six samples and the fast fitting method was able to resolve the double exponential fluorescence lifetimes at only one position. The performance of our algorithm is satisfactory in terms of χ2, which is close to one. The size of the acquired FLIM image is 248×254pixels and the total time sampling is 256 points with time interval 85.9 ps. The proposed method could resolve the biexponential decay for 81% of them, whereas the MN-NLLS and fast fitting methods detected the biexponential for 37% and 17%, respectively. Even the proposed SPIRAL-based algorithm could not detect the biexponential decay for the all data points due to low photon counts, but it is still much better than the conventional algorithms.

Table Grahic Jump Location
Table 2Comparison of estimated fluorescence lifetimes of DOCI and Coumarin 343 fluorescence lifetime imaging microscopy (FLIM) data from MN-NLLS, fast fitting, and the proposed algorithm at arbitrarily selected positions.

Figure 1 shows the lifetime distribution at the (100, 100) pixel position obtained from the proposed method. We can observe two distinct peaks in the distribution. Each estimated lifetime is the amplitude weighted mean of the components and the intensity is the sum of the constituents. Figure 2 presents the observed photon counts at the (100, 50) pixel position of the model acquired from TCSPC and the exponential decay model from estimated lifetime components over time. The black solid line represents the observed photon counts. The red line with a circle, the blue line with a plus, and the green line with a diamond come from the calculation of the biexponential decay estimated from the proposed method, MN-NLLS, and fast fitting method, respectively. The proposed method accurately estimates double exponents; thus, the fitted exponential decay correctly matches the observed data. While the curves from fast fitting and MN-NLLS closely follow the proposed method for the initial stage for the time interval between 0 and 4 ns, these results deviate from the measured photon counts and the proposed method after roughly 4 ns. The fast fitting results diminish faster than those of the MN-NLLS method.

Graphic Jump Location
Fig. 1
F1 :

Lifetime distribution at (100, 100) pixel position from the proposed algorithm. Two distinct lifetime components, 1.67 and 3.31 ns, are resolved.

Graphic Jump Location
Fig. 2
F2 :

Measured and estimated results at (100, 50) pixel position in logarithmic scale; black solid line: measured photon counts, red-dotted line: the estimated result from our proposed method, blue-dashed line: the result from modified Neyman’s nonlinear least squares (MN-NLLS), green dash-dotted line: the result from fast fitting.

Now we demonstrate the performance of the SPIRAL-based algorithm on FLIM-based FRET, which is a powerful tool that provides information about the vicinity between donor- and acceptor-labeled molecules.24 FRET occurs when donor and acceptor molecules are placed within a distance that is close (<10nm) enough to transfer the excited state energy from an initially excited donor to an acceptor.25 After the energy transfer between a donor and an acceptor, the lifetime of the fluorophore is shortened. We adopted a fluorescence amyloid (Aβ) probe, in which fluoresceine isothiocyanate (FITC) is a donor at the end of the N-terminus of Aβ11-25 and 4-dimethylaminophenylazophenyl-4’-maleimide (DABMI) is an acceptor at the end of the C-terminus. FRET provides us not only the conformational information of Aβ, but also the localization of the peptide in the cellular environment. We observed HeLa cells that were grown in Dulbecco’s modified Eagles medium supplemented with 10% (v/v) fetal bovine serum and 1% penicillin. For the confocal and fluorescence lifetime imaging, the cells were plated in a 35-mm glass bottom dish (MatTek Corporation) at low density and grown to 80% confluency on culture dishes at 37°C in a humidified 5% CO2 atmosphere incubator. At first, we analyze a FLIM image without the DABMI acceptor to observe the data without FRET. The fluorescence of the FITC is known to follow a double exponential decay.26,27 As shown in Table 3, the proposed algorithm estimates double exponential lifetimes better than MN-NLLS and fast fitting algorithms. Table 3 shows the estimation results at six typical pixel data: MN-NLLS and fast fitting methods cannot resolve biexponential lifetimes for half of the pixels, while the presented method estimates biexponential decay at five positions. The size of the acquired FLIM image is 256×256pixels. The proposed method could resolve the biexponential decay for 97% of them, whereas the MN-NLLS and fast fitting methods detected biexponential for 56% and 68%, respectively. Please note that our method does not estimate just two lifetime components; it estimates the distribution of a lifetime, which is a more accurate model for the fluorescence decay.

Table Grahic Jump Location
Table 3Comparison of estimated fluorescence lifetimes of fluoresceine isothiocyanate (FITC) FLIM data for HeLa cells from MN-NLLS, fast fitting, and the proposed algorithm at arbitrary positions.

Figure 3 shows the FLIM images and distributions of lifetimes without and with an acceptor in a HeLa cell estimated by SPC software and the proposed method. Figures 3(a) and 3(c) are FITC-Aβ11-25 donor FLIM images analyzed for the same TCSPC photon counts: Fig. 3(a) was obtained using SPC software and Fig 3(c) from the proposed method. Similarly, Figs. 3(e) and 3(g) are FITC-Aβ11-25-DABMI donor–acceptor FLIM images analyzed by the two algorithms, where Fig. 3(e) is from the SPC software and Fig. 3(g) is from the proposed method. To generate these FLIM images with multiple lifetimes, we used the intensity weighted mean lifetime at each pixel and it is coded with pseudo color. The left column shows FLIM images and the right column corresponds to lifetime distributions. As stated above, the pseudo color of the FLIM image in Figs. 3(e) and 3(g), which show shortened lifetimes due to FRET, is more yellowish than Figs. 3(a) and 3(c), respectively. SPC software shows a single lifetime parameter: it shows a peak at 2.5 ns in Fig. 3(b) and the peak position changes to 1.8 ns in Fig. 3(f) after FRET. The same TCSPC data are analyzed by SPIRAL: it estimates two distinctive peaks at 1.8 and 3.4 ns as shown in Fig. 3(d). The amplitude of the 1.8 ns component increases after FRET, while the amplitude of the 3.4 ns component decreases, as observed in Fig. 3(h). The distribution of the lifetime after FRET shows that energy transfer dominantly occurs at 1.8 ns. Since a HeLa cell has biological structure, it cannot be uniformly stained. Moreover, the reaction of FITC differs depending on the local environment such as pH distribution or strain. We believe that the spatial nonuniformity that resulted from the proposed method shows the spatial variation of the structure and the local environment of the cell, while the conventional SPC method cannot resolve the fine details. Thus, the ability to show the fine structure of the HeLa cell reflects an improvement in the quality of the proposed imaging technique. Also please note that the SPIRAL analysis of Figs. 3(c) and 3(g) delineates cell boundary much better than the corresponding images of Figs. 3(a) and 3(e) from the SPC software. Although Fig. 3(c) is the image composed by the data obtained before FRET occurs, the data still have double lifetimes due to the characteristics of FITC and the lifetime in each local region varies significantly depending on pH concentration.1 Therefore, local homogeneous regions in Fig. 3(c) imply similar pH concentrations in the region. Since Fig. 3(g) is an image after FRET occurs, Fig. 3(g) shows the homogeneous regions with blue or yellow pseudo colors. The bluish region is where FRET does not occur, while the yellowish region represents where FRET occurs, since the region with FRET has shorter lifetimes than the region without FRET. Reference 1 supports this phenomenon. The experimental results demonstrate the applicability of the proposed method to the multiexponential decay of fluorophores from low count cell data, where the maximum count is around 40 photons.

Graphic Jump Location
Fig. 3
F3 :

Comparison of fluorescence lifetime imaging microscopy (FLIM) images and the distributions of intensity weighted lifetimes between the proposed method and SPC software (a) FITC-Aβ FLIM image for HeLa cell using SPC software. (b) The corresponding distribution of lifetime for (a). (c) The same FITC-Aβ FLIM image analyzed by sparse Poisson intensity reconstruction algorithm (SPIRAL). (d) The corresponding distribution of lifetime for (c). (e) FITC-Aβ-DABMI FLIM image for HeLa cell using SPC software. (f) The corresponding distribution of lifetime for (e). (g) The same FITC-Aβ-DABMI FLIM image analyzed by SPIRAL. (h) The corresponding distribution of lifetime for (g).

We presented a powerful method to estimate the distribution of fluorescence lifetime using Poisson noise modeling and L1-norm regularization. We use the sensing matrix A based on the multiexponential decay of fluorophores and the instrument response function, together with L1-norm regularization for compressive sensing.

We verified that the presented algorithm shows a more robust estimation of lifetime than the maximum-likelihood estimator based on a Poisson noise from computer simulations and a more accurate distribution with real cell with low photon count images with FRET. SPIRAL has the merit of showing the width or distribution of lifetime components. We need extensive work for the theoretical analysis and practical evaluation of SPIRAL. For future work, we can incorporate a spatial prior in order to improve the quality of FLIM images.

This work was supported in part by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (NRF-2012R1A1A3013525) and by the Bio and Medical Technology Development Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (MEST) (No. 2012M3A9B6055379).

Lakowicz  J. R., Principles of Fluorescence Spectroscopy. ,  Springer ,  New York  (2006).
Collier  B. B., and McShane  M. J., “Dynamic windowing algorithm for the fast and accurate determination of luminescence lifetimes,” Anal. Chem.. 84, , 4725 –4731 (2012). 0003-2700 CrossRef
Wahl  M., Technical Note on Time-correlated Single Photon Counting. ,  PicoQuant GmbH ,  Berlin  (2009).
Won  Y.  et al., “High-speed confocal fluorescence lifetime imaging microscopy (FLIM) with the analog mean delay (AMD) method,” Opt. Express. 19, (4 ), 3396 –3404 (2011). 1094-4087 CrossRef
Skala  M. C.  et al., “In vivo multiphoton microscopy of NADH and FAD redox states, fluorescence lifetimes, and cellular morphology in precancerous epithelia,” Proc. Natl. Acad. Sci. U.S.A.. 104, (49 ), 19494 –19499 (2007).CrossRef
Roberts  M. S.  et al., “Non-invasive imaging of skin physiology and percutaneous penetration using fluorescence spectral and lifetime imaging with multiphoton and confocal microscopy,” Eur. J. Pharm. Biopharm.. 77, , 469 –488 (2011). 0939-6411 CrossRef
Deka  G., , Wu  W. W., and Kao  F. J., “In vivo wound healing diagnosis with second harmonic and fluorescence lifetime imaging,” J. Biomed. Opt.. 18, (6 ), 061222  (2013). 1083-3668 CrossRef
O’Connor  D. V., and Phillips  D., Time-Correlated Single Photon Counting. ,  Academic Press ,  London  (1984).
McKinnon  A. E., , Szabo  A. G., and Millar  D. R., “The deconvolution of photoluminescence data,” J. Phys. Chem.. 81, (16 ), 1564 –1570 (1977). 0022-3654 CrossRef
O’Connor  D. V., , Ware  W. R., and Andre  J. C., “Deconvolution of fluorescence decay curves. A critical comparison of techniques,” J. Phys. Chem.. 83, , 1333 –1343 (1979). 0022-3654 CrossRef
Knutson  J. R., , Beechem  J. M., and Brand  L., “Simultaneous analysis of multiple fluorescence decay curves: a global approach,” Chem. Phys. Lett.. 102, (6 ), 501 –507 (1983). 0009-2614 CrossRef
Hauschild  T., and Jentschel  M., “Comparison of maximum likelihood estimation and chi-square statistics applied to counting experiments,” Nucl. Instrum. Methods Phys. Res., Sect. A. 457, , 384 –401 (2001). 0168-9002 CrossRef
Sasaki  K., and Masuhara  H., “Analysis of transient emission curves by a convolved autoregressive model,” Appl. Opt.. 30, (8 ), 977 –980 (1991).CrossRef
Apanasovich  V. V., and Novikov  E. G., “Identification of lifetime characteristics in fluorescence experiments,” Proc. SPIE. 2388, , 378 –384 (1995). 0277-786X CrossRef
Enderlein  J., and Erdmann  R., “Fast fitting of multiexponential decay curves,” Opt Commun.. 134, , 371 –378 (1997).CrossRef
Kim  J., and Seok  J., “Statistical properties of amplitude and decay parameter estimators for fluorescence lifetime imaging,” Opt. Express. 21, (5 ), 6061 –6074 (2013). 1094-4087 CrossRef
Harmany  Z. T., , Marcia  R. F., and Willett  R. M., “This is SPIRAL-TAP: sparse Poisson intensity reconstruction algorithms-theory and practice,” IEEE Trans. Image Process.. 21, (3 ), 1084 –1096 (2012). 1057-7149 CrossRef
Becker  W., The bh TCSPC Handbook. , 5th ed.,  Becker & Hickl GmbH ,  Berlin  (2012).
Donoho  D. L., “Compressed sensing,” IEEE Trans. Inf. Theory. 52, (4 ) 1289 –1306 (2006). 0018-9448 CrossRef
Candes  E. J., and Tao  T., “Decoding by linear programming,” IEEE Trans. Inf. Theory. 51, (12 ), 4203 –4215 (2006). 0018-9448 CrossRef
Candes  E., , Romberg  J., and Tao  T., “Near-optimal signal recovery from random projection: universal encoding from highly incomplete frequency information,” IEEE Trans. Inf. Theory. 52, (12 ), 5406 –5425 (2006). 0018-9448 CrossRef
Willett  R., and Raginsky  M., “Performance bounds for compressed sensing with Poisson noise,” in  Proc. IEEE Int. Symp. Information Theory , pp. 174 –178, (2009).
Raginsky  M., and Harmany  Z. T., “Compressed sensing performance bounds under Poisson noise,” IEEE Trans. Signal Process.. 58, (8 ), 3990 –4002 (2010). 1053-587X CrossRef
Caron  N. S.  et al., “Using FLIM-FRET to measure conformational changes of transglutaminase type 2 in live cells,” PLoS One. 7, (8 ), e44159  (2012). 1932-6203 CrossRef
Valeur  B., and Berberan-Santos  M. N., Molecular Fluorescence Principles and Applications. ,  Wiley-VCH , (2012).
Swindlehurst  C. A., and Voss  E. W.  Jr., “Fluorescence measurements of immune complexes of Mab 4-4-20 with isomeric haptens,” Biophys. J.. 59, , 619 –628 (1991). 0006-3495 CrossRef
Santra  S.  et al., “Fluorescence lifetime measurements to determine the core-shell nanostructure of FITC-doped silica nanoparticles: an optical approach to evaluate nanoparticle photostability,” J. Lumin.. 117, , 75 –82 (2006). 0022-2313 CrossRef

Sejung Yang is a research assistant professor at the Ewha Womans University. She received her BS degree in electrical engineering from the Ewha Womans University in 2001, her MS degree in electrical engineering from the University of Southern California in 2005, and her PhD in electronics engineering from the Ewha Womans University in 2011. Her current research interests include image processing and biomedical imaging.

Joohyun Lee received her BS degree in electrical engineering from Ewha Womans University in 2010 and her MS degree in 2012. Currently, she is an associate research engineer at KT Institute of convergence technology. Her research interests include color image enhancement, denoising, and medical image processing.

Youmin Lee received her bachelor’s degree from the Department of Chemistry and Nanoscience, Ewha Womans University in South Korea in 2012, where she worked toward a master’s degree in the physical chemistry group. She received her MS degree in 2014. Her research was focused on investigating photophysics of fluorescence probes in microenvironments using time-resolved fluorescence.

Minyung Lee has been a professor in the Department of Chemistry and Nanoscience at Ewha Womans University. He completed his doctorate in physical chemistry at the University of Pennsylvania in 1987. He developed a couple of measurement techniques incorporating atomic force microscopy and fluorescence lifetime imaging microscopy (FLIM). His major research field has been biomolecular dynamics and current research interest includes investigations on the structural dynamics and aggregation processes of peptides and proteins, employing FLIM.

Byung-Uk Lee received his BS degree from Seoul National University in 1979, his MS degree from the KAIST in 1981, and his PhD in electrical engineering from Stanford University in 1991. He worked for Daewoo Electronics Co. from 1991 to 1995. He joined the Department of Electronics Engineering, Ewha Womans University in 1995, where he is currently a professor. His research interests include color image enhancement, denoising, and medical image processing.

© The Authors. Published by SPIE under a Creative Commons Attribution 3.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.

Citation

Sejung Yang ; Joohyun Lee ; Youmin Lee ; Minyung Lee and Byung-Uk Lee
"Estimation of multiexponential fluorescence decay parameters using compressive sensing", J. Biomed. Opt. 20(9), 096003 (Sep 03, 2015). ; http://dx.doi.org/10.1117/1.JBO.20.9.096003


Figures

Graphic Jump Location
Fig. 1
F1 :

Lifetime distribution at (100, 100) pixel position from the proposed algorithm. Two distinct lifetime components, 1.67 and 3.31 ns, are resolved.

Graphic Jump Location
Fig. 2
F2 :

Measured and estimated results at (100, 50) pixel position in logarithmic scale; black solid line: measured photon counts, red-dotted line: the estimated result from our proposed method, blue-dashed line: the result from modified Neyman’s nonlinear least squares (MN-NLLS), green dash-dotted line: the result from fast fitting.

Graphic Jump Location
Fig. 3
F3 :

Comparison of fluorescence lifetime imaging microscopy (FLIM) images and the distributions of intensity weighted lifetimes between the proposed method and SPC software (a) FITC-Aβ FLIM image for HeLa cell using SPC software. (b) The corresponding distribution of lifetime for (a). (c) The same FITC-Aβ FLIM image analyzed by sparse Poisson intensity reconstruction algorithm (SPIRAL). (d) The corresponding distribution of lifetime for (c). (e) FITC-Aβ-DABMI FLIM image for HeLa cell using SPC software. (f) The corresponding distribution of lifetime for (e). (g) The same FITC-Aβ-DABMI FLIM image analyzed by SPIRAL. (h) The corresponding distribution of lifetime for (g).

Tables

Table Grahic Jump Location
Table 1Simulation results of fluorescence lifetime estimation using modified Neyman’s nonlinear least squares (MN-NLLS) algorithm,12 fast fitting,15 maximum-likelihood method,16 and our algorithm (true values of lifetimes: 2, 6 ns and true values of amplitudes: 100, 100).
Table Grahic Jump Location
Table 2Comparison of estimated fluorescence lifetimes of DOCI and Coumarin 343 fluorescence lifetime imaging microscopy (FLIM) data from MN-NLLS, fast fitting, and the proposed algorithm at arbitrarily selected positions.
Table Grahic Jump Location
Table 3Comparison of estimated fluorescence lifetimes of fluoresceine isothiocyanate (FITC) FLIM data for HeLa cells from MN-NLLS, fast fitting, and the proposed algorithm at arbitrary positions.

References

Lakowicz  J. R., Principles of Fluorescence Spectroscopy. ,  Springer ,  New York  (2006).
Collier  B. B., and McShane  M. J., “Dynamic windowing algorithm for the fast and accurate determination of luminescence lifetimes,” Anal. Chem.. 84, , 4725 –4731 (2012). 0003-2700 CrossRef
Wahl  M., Technical Note on Time-correlated Single Photon Counting. ,  PicoQuant GmbH ,  Berlin  (2009).
Won  Y.  et al., “High-speed confocal fluorescence lifetime imaging microscopy (FLIM) with the analog mean delay (AMD) method,” Opt. Express. 19, (4 ), 3396 –3404 (2011). 1094-4087 CrossRef
Skala  M. C.  et al., “In vivo multiphoton microscopy of NADH and FAD redox states, fluorescence lifetimes, and cellular morphology in precancerous epithelia,” Proc. Natl. Acad. Sci. U.S.A.. 104, (49 ), 19494 –19499 (2007).CrossRef
Roberts  M. S.  et al., “Non-invasive imaging of skin physiology and percutaneous penetration using fluorescence spectral and lifetime imaging with multiphoton and confocal microscopy,” Eur. J. Pharm. Biopharm.. 77, , 469 –488 (2011). 0939-6411 CrossRef
Deka  G., , Wu  W. W., and Kao  F. J., “In vivo wound healing diagnosis with second harmonic and fluorescence lifetime imaging,” J. Biomed. Opt.. 18, (6 ), 061222  (2013). 1083-3668 CrossRef
O’Connor  D. V., and Phillips  D., Time-Correlated Single Photon Counting. ,  Academic Press ,  London  (1984).
McKinnon  A. E., , Szabo  A. G., and Millar  D. R., “The deconvolution of photoluminescence data,” J. Phys. Chem.. 81, (16 ), 1564 –1570 (1977). 0022-3654 CrossRef
O’Connor  D. V., , Ware  W. R., and Andre  J. C., “Deconvolution of fluorescence decay curves. A critical comparison of techniques,” J. Phys. Chem.. 83, , 1333 –1343 (1979). 0022-3654 CrossRef
Knutson  J. R., , Beechem  J. M., and Brand  L., “Simultaneous analysis of multiple fluorescence decay curves: a global approach,” Chem. Phys. Lett.. 102, (6 ), 501 –507 (1983). 0009-2614 CrossRef
Hauschild  T., and Jentschel  M., “Comparison of maximum likelihood estimation and chi-square statistics applied to counting experiments,” Nucl. Instrum. Methods Phys. Res., Sect. A. 457, , 384 –401 (2001). 0168-9002 CrossRef
Sasaki  K., and Masuhara  H., “Analysis of transient emission curves by a convolved autoregressive model,” Appl. Opt.. 30, (8 ), 977 –980 (1991).CrossRef
Apanasovich  V. V., and Novikov  E. G., “Identification of lifetime characteristics in fluorescence experiments,” Proc. SPIE. 2388, , 378 –384 (1995). 0277-786X CrossRef
Enderlein  J., and Erdmann  R., “Fast fitting of multiexponential decay curves,” Opt Commun.. 134, , 371 –378 (1997).CrossRef
Kim  J., and Seok  J., “Statistical properties of amplitude and decay parameter estimators for fluorescence lifetime imaging,” Opt. Express. 21, (5 ), 6061 –6074 (2013). 1094-4087 CrossRef
Harmany  Z. T., , Marcia  R. F., and Willett  R. M., “This is SPIRAL-TAP: sparse Poisson intensity reconstruction algorithms-theory and practice,” IEEE Trans. Image Process.. 21, (3 ), 1084 –1096 (2012). 1057-7149 CrossRef
Becker  W., The bh TCSPC Handbook. , 5th ed.,  Becker & Hickl GmbH ,  Berlin  (2012).
Donoho  D. L., “Compressed sensing,” IEEE Trans. Inf. Theory. 52, (4 ) 1289 –1306 (2006). 0018-9448 CrossRef
Candes  E. J., and Tao  T., “Decoding by linear programming,” IEEE Trans. Inf. Theory. 51, (12 ), 4203 –4215 (2006). 0018-9448 CrossRef
Candes  E., , Romberg  J., and Tao  T., “Near-optimal signal recovery from random projection: universal encoding from highly incomplete frequency information,” IEEE Trans. Inf. Theory. 52, (12 ), 5406 –5425 (2006). 0018-9448 CrossRef
Willett  R., and Raginsky  M., “Performance bounds for compressed sensing with Poisson noise,” in  Proc. IEEE Int. Symp. Information Theory , pp. 174 –178, (2009).
Raginsky  M., and Harmany  Z. T., “Compressed sensing performance bounds under Poisson noise,” IEEE Trans. Signal Process.. 58, (8 ), 3990 –4002 (2010). 1053-587X CrossRef
Caron  N. S.  et al., “Using FLIM-FRET to measure conformational changes of transglutaminase type 2 in live cells,” PLoS One. 7, (8 ), e44159  (2012). 1932-6203 CrossRef
Valeur  B., and Berberan-Santos  M. N., Molecular Fluorescence Principles and Applications. ,  Wiley-VCH , (2012).
Swindlehurst  C. A., and Voss  E. W.  Jr., “Fluorescence measurements of immune complexes of Mab 4-4-20 with isomeric haptens,” Biophys. J.. 59, , 619 –628 (1991). 0006-3495 CrossRef
Santra  S.  et al., “Fluorescence lifetime measurements to determine the core-shell nanostructure of FITC-doped silica nanoparticles: an optical approach to evaluate nanoparticle photostability,” J. Lumin.. 117, , 75 –82 (2006). 0022-2313 CrossRef

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.