Research Papers: Imaging

Optically sectioned in vivo imaging with speckle illumination HiLo microscopy

[+] Author Affiliations
Daryl Lim, Tim N. Ford, Kengyeh K. Chu, Jerome Mertz

Boston University, Department of Biomedical Engineering, 44 Cummington Street, Boston, Massachusetts 02215

J. Biomed. Opt. 16(1), 016014 (January 31, 2011). doi:10.1117/1.3528656
History: Received September 29, 2010; Revised November 15, 2010; Accepted November 30, 2010; Published January 31, 2011; Online January 31, 2011
Text Size: A A A

Open Access Open Access

* Address all correspondence to Jerome Mertz, Boston University, Department of Biomedical Engineering, 44 Cummington St., Boston, MA 02215. Tel: 617-358-0746; Fax: 617-353-6766; E-mail: jmertz@bu.edu.

We present a simple wide-field imaging technique, called HiLo microscopy, that is capable of producing optically sectioned images in real time, comparable in quality to confocal laser scanning microscopy. The technique is based on the fusion of two raw images, one acquired with speckle illumination and another with standard uniform illumination. The fusion can be numerically adjusted, using a single parameter, to produce optically sectioned images of varying thicknesses with the same raw data. Direct comparison between our HiLo microscope and a commercial confocal laser scanning microscope is made on the basis of sectioning strength and imaging performance. Specifically, we show that HiLo and confocal 3-D imaging of a GFP-labeled mouse brain hippocampus are comparable in quality. Moreover, HiLo microscopy is capable of faster, near video rate imaging over larger fields of view than attainable with standard confocal microscopes. The goal of this paper is to advertise the simplicity, robustness, and versatility of HiLo microscopy, which we highlight with in vivo imaging of common model organisms including planaria, C. elegans, and zebrafish.

Figures in this Article

Fluorescence microscopy is commonly used to image biological specimens. The conventional wide-field fluorescence microscope provides high-resolution imaging for thin samples but suffers from poor contrast in thick samples due to the inevitable generation of background fluorescence in a standard K

ö
hler illumination setup. The rejection of such background fluorescence leads not only to improved image contrast, but also 3-D resolution since the fluorescence intensity represented in the image is confined to a thin optical section. A variety of techniques that exhibit optical sectioning have been developed, the most ubiquitous being confocal laser scanning microscopy, often simply referred to as confocal microscopy.1 Many of these techniques work by shaping the illumination into a fixed pattern which results in an image that is inherently optically sectioned, or can be post-processed into an optically sectioned image. For example, confocal microscopy, two-photon excited fluorescence (TPEF)2 microscopy and other scanning illumination techniques rely on shaping the illumination into one or more focal spots. Other techniques such as structured illumination microscopy (SIM) and programmable array microscopy (PAM) depend on the generation of grid illumination at the focal plane,34 while sheet illumination techniques rely on confining a thin sheet of illumination to the focal plane.56

While these patterned illumination techniques each have their own advantages and are capable of producing excellent images under favorable conditions, their success invariably depends on the delivery of well defined and controlled illumination patterns into the sample. Recently, we have demonstrated a technique called dynamic speckle illumination (DSI) microscopy that produces fluorescence sectioning with illumination patterns that are neither well defined nor controlled.79 The idea of this technique is to illuminate a fluorescent sample with random speckle patterns obtained from a laser. Speckle patterns are granular intensity patterns that exhibit inherently high contrast. Fluorescence images obtained with speckle illumination are therefore also granular; however, the contrast of the observed granularity provides a measure of how in focus the sample is: high observed contrast indicates that the sample is dominantly in focus, whereas low observed contrast indicates it is dominantly out of focus. The observed speckle contrast thus serves as a weighting function indicating the in-focus to out-of-focus ratio in a fluorescence image. A key feature of speckle illumination is that while the exact intensity pattern incident on a sample is not known, the statistics of the intensity distribution are well known to obey a negative exponential probability distribution (provided the speckle is fully developed.10) According to this distribution, the contrast of a speckle pattern scales with average illumination intensity. Thus, weighting a fluorescence image by the observed speckle contrast is equivalent to weighting it by the average illumination intensity (as in standard imaging), however with the benefit that the weighting preferentially extracts only in-focus signal. A second key feature of speckle illumination is that its statistics are invariant even in a scattering medium, since unpredictable phase shifts induced by the medium only further randomize an already randomized laser phase front. Hence fluorescence sectioning based on speckle illumination is robust, since it is insensitive to scattering, aberrations, etc., in the illumination path.

In our original implementation of DSI microscopy, speckle contrast was measured by illuminating a sample with a series of independent speckle patterns, and evaluating the variations in the observed speckle intensity over time. While effective, this technique proved to be slow since several images were required to obtain an accurate estimate of speckle contrast. A later implementation involved evaluating speckle contrast in space rather than time, using a single image. Such an evaluation inevitably entails a loss in spatial resolution; however, it was found that a second image obtained by standard uniform illumination could supply the missing high resolution information, ultimately resulting in a full (i.e., diffraction-limited) resolution, optically sectioned image from only two images. This technique is called HiLo microscopy.1113

The goal of this paper is to demonstrate the unique advantages of HiLo imaging, using an improved algorithm from what was previously described and a more robust experimental layout, leading to significantly enhanced performance. We provide a direct comparison of HiLo microscopy with state-of-the-art confocal microscopy, and demonstrate a remarkable feature of HiLo microscopy that it provides a depth of field that can be fully tuned a posteriori (i.e., with the same set of two images). Moreover, we demonstrate for the first time in vivo imaging with real-time HiLo processing of exogenous and endogenous (GFP) labeled samples, in both high resolution microscopy and wide field of view (FOV) macroscopy configurations.

A speckle illumination HiLo microscope is essentially a conventional wide-field fluorescence microscope with laser illumination and a digital camera (Fig. 1). The key difference lies in the introduction of a diffuser in the illumination path of the HiLo microscope. The diffuser randomizes the phase front of the laser beam, resulting in a speckle pattern which is projected into the sample via a microscope objective. One of the two images required for HiLo processing,

Is
, is thus captured with speckle illumination. The second image, Iu, is captured with uniform illumination. To obtain the latter, we rapidly randomize the speckle pattern within a single exposure of the camera, effectively simulating uniform illumination. Randomization of the speckle pattern is most easily achieved by translating or rotating the diffuser. We have found that attaching a small diffuser to a galvanometer motor provides simple and reliable speckle randomization, with rapid response times that are crucial for high-speed imaging. The images acquired under speckle and uniform illumination are thus, respectively, Display Formula
1Is(ρd)= PSF det(ρdρ,z)O(ρ,z)S(ρ,z)d2ρdz,
Display Formula
2Iu(ρd)= PSF det(ρdρ,z)O(ρ,z)Sd2ρdz,
where PSF det(ρ,z) is the 3-D detection point spread function of the microscope, O(ρ,z) is the 3-D object distribution, and S(ρ,z) is the 3-D speckle illumination intensity [note: in the case of uniform illumination, S(ρ,z) becomes randomized and averages to a constant 〈S〉]. For simplicity, we have assumed PSF det to be of unit magnification.

Grahic Jump LocationF1 :

A HiLo microscope setup is identical to a standard wide-field epi-fluorescence microscope except for the addition of a laser beam and diffuser in the illumination path, resulting in speckle illumination at the sample. The resulting fluorescence is captured by a digital camera. When the diffuser is static, the speckle illumination exhibits high contrast (top right panel). When the diffuser is rapidly oscillated by a galvanometric motor, the resulting speckle becomes blurred over the course of the camera exposure, effectively simulating uniform illumination (bottom right panel). Speckle and uniform illumination images are acquired pairwise, and processed into an optically sectioned HiLo image.

Equation 2 corresponds to a standard wide-field image. This image fails to exhibit optical sectioning because energy conservation requires

PSF det(ρ,z)d2ρ
to remain constant, independent of z. That is, if PSF det(ρ,z) is interpreted as a weighting function applied to O(ρ,z), this weighting function, globally, does not decay with defocus.

In contrast, we may look at the difference image

δI(ρd)=Is(ρd)Iu(ρd)
, given by Display Formula
3δI(ρd)= PSF det(ρdρ,z)δS(ρ,z)O(ρ,z)d2ρdz,
where δS(ρ,z)=S(ρ,z)S. The weighting function is now the term in square brackets. We find that this function does, globally, decay with defocus. Specifically, the larger the defocus, the broader PSF det(ρ,z), and hence the more δS(ρ,z) becomes spatially averaged to zero. The decay to zero can be further accelerated by numerically applying an extra filter W(ρd) to the difference image, obtaining, Display Formula
4δI(ρd)=W(ρdρ) PSF det(ρρ,z)δS(ρ,z)×O(ρ,z)d2ρd2ρdz.
The role of this extra filter will be made clear below.

As noted above, HiLo microscopy relies on a knowledge of the statistics of the speckle illumination pattern. For speckle that is fully developed and close to the optical axis, the transverse autocorrelation of the speckle variations is given by14Display Formula

5δS(ρ,z)δS(ρ,z)=S2As PSF ill (|ρρ|,|zz|),
where PSF ill (ρ,z) is the illumination point spread function, which, in general, may differ from PSF det, and As= PSF ill (0,0)1 roughly corresponds to the average transverse area of a speckle grain.

To understand how HiLo imaging performs optical sectioning, it is instructive to evaluate the contrast of the

imaged
speckle variations as a function of defocus. Specifically, let us consider a uniform plane object located at a defocus position z (where z = 0 is in focus). When this object is illuminated by speckle, the resulting granular fluorescence variations, upon imaging, exhibit a contrast given by Display Formula
6Cδs(z)=σδs(z)Is=σδs(z)Iu,
where σδs(z) denotes the standard deviation of the imaged fluorescence variations. An evaluation of this contrast is more easily performed in frequency space. To this end, the optical transfer functions associated with the PSFs are defined to be Display Formula
7 OTF (κ,z)= PSF (ρ,z)ei2πκ·ρd2ρ
and, similarly, W(κ) is defined to be the Fourier transform of W(ρ).

Finally, from Eqs. 46 we arrive at Display Formula

8Cδs2(z)=AsW(κ)2 OTF det(κ,z)2 OTF ill (κ,0)d2κ.
The above result is the basis of speckle illumination HiLo microscopy. As emphasized above, the imaged speckle contrast Cδs(z) may be interpreted as a weighting function that is peaked when the object is in focus and decays to zero as the object goes out of focus. We observe that Cδs(z) indeed obeys this property. The role of the extra filter W(ρ) included in Eq. 4 also becomes apparent. For example, let us consider the case where the filter is absent (i.e., where W(κ)1). It can be shown in this case that Cδs(z) scales as z1 for large z. This scaling law is intermediate between the scaling laws prescribed by OTF det(κ0,z)z3/2 and OTF det(κ=0,z)= constant.1516 If we introduce now a highpass filter such that W(0)=0, thereby deleting the κ=0 contribution in the integral, we find that Cδs(z) obeys instead the improved scaling law z3/2. Moreover, by adjusting the width of this highpass filter, we can tune the width of the sectioning strength, as will be demonstrated below. In practice, W(ρ) can be generalized to be a bandpass filter (previously termed a wavelet prefilter in Ref. 9).

A crucial assumption in the above evaluation of

Cδs(z)
is that the contrast reflect the variations only in the imaged speckle and not in the object itself. In our previous HiLo implementation, we evaluated the local contrast of the speckle and uniform illumination images separately, and used the latter to correct for object-induced variations in the former. The more robust method introduced here is to evaluated the local contrast directly in the difference image. A low resolution estimate of the in-focus image is then constructed by applying a lowpass filter (LP) to the weighted uniform illumination image, obtaining I LP (ρd)= LP [Cδs(ρd)Iu(ρd)]. As described in Ref. 11, complementary high resolution information is constructed by applying a highpass filter HP (κ)=1 LP (κ) directly to the uniform illumination image, obtaining I HP (ρd)= HP Iu(ρd). The final HiLo image is synthesized from the fusion of the above two images, resulting in Display Formula
9I HiLo (ρd)=ηI LP (ρd)+I HP (ρd),
where η is a scaling function that ensures a seamless transition from low to high spatial frequencies. Specifically, η compensates for the fact that the imaged speckle contrast is, in general, not equal to one even for objects that are in focus. From Eq. 8, we thus find η=Cδs(0)1. In practice, η can be estimated a priori based on a knowledge of the illumination and detection PSFs, or, alternatively, it can be inferred experimentally directly from I LP and I HP .11

So far, we have neglected the effects of noise in our algorithm. Shot noise and readout noise introduce additional fluctuations in

Is(ρd)
and Iu(ρd), which in turn leads to a bias in the quantification of Cδs2. However, this bias can be corrected for based on our a priori knowledge of the noise statistics. Specifically, for a camera gain G and readout noise variance σr2 the noise-induced bias is given by Display Formula
10σn2(ρd)=GIs+GIu+σr2W(κ)2d2κ.
The first two terms, GIs and GIu, are variance contributions of shot noise. Filtering has the effect of reducing noise variance and is taken into account with the integral term. This bias must thus be subtracted from σδs2(ρd) prior to the evaluation of Cδs(ρd).

We have also not considered the effects of pixelation in the CCD camera. If the pixel size is non-negligible compared to the size of the illumination or detection PSFs, then the additional filtering introduced by the pixels must be taken into account. This additional filtering can be incorporated in

W(ρd)
.

The steps for obtaining

I HiLo (ρd)
are summarized below:

  1. Subtract

    Iu(ρd) from Is(ρd) to form δI(ρd).

  2. Bandpass

    δI(ρd) with a user-defined filter W(ρd).

  3. Evaluate

    Cδs2(ρd) according to Eq. 6.

  4. Remove the noise-induced bias from

    Cδs2(ρd) by subtracting σn2(ρd).

  5. Construct LP and complimentary HP filters (based on the choice of

    W(ρd) — see below).

  6. Evaluate η according to Eq. 8.

  7. Evaluate

    I HiLo (ρd) according to Eq. 9.

All HiLo images were acquired with a home-built setup. A 491-nm diode-pumped solid state laser (50-mW Cobolt Calypso, leading to 4 mW at the sample) was used as a light source and a CCD camera (Qimaging Retiga-2000R) was used to detect the signal. Speckle illumination was generated with a small piece of diffuser (Luminit LSD) glued to the mirror of a galvonometer scanner (Sonima SM2804) placed roughly in a plane conjugate to the back aperture of the objective. Control and synchronization of the galvonometer and camera was carried out with National Instruments LabView.

The image processing1 algorithm was initially run post-acquisition in Matlab (Mathworks) using the DIPimage toolbox (Technical University Delft). Subsequently the image processing was rewritten in CUDA-C to take advantage of the parallel computing architecture offered by graphical processing units (GPU). In particular, the GPU used was a NVIDIA GeForce GTX 280. This greatly shortened processing times, particularly for fast Fourier transforms, facilitating real-time processing of HiLo images. For example, the time taken to process a 1024×1024 image was shortened from 875 ms in Matlab to <40 ms with our CUDA-C implementation. For the results presented below, in vivo videos were acquired and processed at 7 fps (raw acquisition rate was 14 fps).

Confocal microscopy remains the most common tool for obtaining background-free images. For HiLo microscopy to be broadly accepted by the bioimaging community, it is thus vital that HiLo and confocal microscopies be directly compared. To this end, we performed volumetric imaging of the same sample, namely cytoplasmic EGFP labeled mouse brain hippocampus, using both modalities. Single frames as well as extended focus images derived from a z stack are presented in Fig. 2 and 1. As expected, conventional wide-field microscopy [Fig. 2] suffers from the presence of background fluorescence, whereas both HiLo and confocal microscopy produced optically sectioned images of much higher contrast [Fig. 2]. Extended focus images from the HiLo and confocal microscopes in 1 clearly reveal fine details in the neuronal arborization, despite the scattering nature of the sample. Background rejection enables not only improved resolution of neuronal structures but also 3-D reconstructions, where it is apparent that both techniques provide high-quality reconstructions that are largely identical.

Grahic Jump LocationF2 :

Volumetric imaging of a mouse brain hippocampus slice (100 μm thick) labeled by cytoplasmic EGFP by in utero electroporation.17z-stacks comprising 200 slices with 0.5 μm step size were acquired with a HiLo microscope and a commercial confocal microscope (Olympus FluoView 1000), in both cases using a 20× water immersion objective (Olympus UApo/340). Co-located z-slices (single frames) presented in the left column were taken with (a) standard wide-field microscopy; (b) HiLo microscopy; and (c) confocal microscopy. HiLo exposure time was 2×400 ms per slice (power limited with an illumination power at the sample of about 4 mW), with images acquired at 1200×1200 resolution. Confocal exposure time was 2880 ms per slice (scan speed limited). Scale bar is 50 μm.

A quantitative comparison of the background rejection capacity of HiLo and confocal microscopy can be obtained from sectioning curves (also called plane spread functions). A sectioning curve plots the integrated detected power produced by a thin, uniform, and in this case fluorescent, plane as a function of defocus, z. The profile of this function thus characterizes the sectioning strength of the imaging system. Using the same objective (Olympus LCPlanFL N) and sample (a thin, uniform film of FITC-albumin conjugate on a coverslip), we experimentally obtained sectioning curves for our home-built HiLo microscope (solid blue line) and a commercial state-of-the-art confocal microscope (solid red line) shown in Fig. 3. Both systems demonstrate optical sectioning, as is manifested by the sharp decay in signal with defocus. Both curves exhibit similar widths, though the confocal curve has a marginally narrower full-width at half-maximum (FWHM), indicative of the slightly stronger sectioning expected by theory. The most distinctive difference between the two curves is the asymmetry and presence of sidelobes in the confocal sectioning curve. Such anomalies are well-documented and have been shown to be the result of spherical aberrations and the presence of a hard-edged confocal pinhole.18 These same effects are completely circumvented with HiLo microscopy since no physical pinhole is used and also because the statistics of speckle illumination are largely unaffected by spherical (or any other) aberrations.

Grahic Jump LocationF3 :

(a) Confocal sectioning curve (solid red line) and HiLo sectioning curves processed with different

σw ’s (solid blue and dashed lines) using the same data. (b) Bandpass filters used to generate HiLo sectioning curves (solid blue and dashed lines). Solid black line depicts the magnitude of the in-focus detection OTF for comparison. (c) FWHM (averaged over nine measurements) of HiLo sectioning curves as a function of σw1. Dashed cyan line indicates a linear fit (R2=0.998).

As described in the previous section, the sectioning ability of a HiLo microscope can be tuned by adjusting the bandpass filter

W(κ)
. For example, we use a bandpass filter defined in frequency space by the difference of two Gaussians: Display Formula
11W(κ)= exp κ22σw2 exp κ2σw2.
Such a filter is specified by a single parameter σw and fulfills the criterion that W(0)=0 [Fig. 3]. A numerical evaluation of Eqs. 8,11 reveals that the FWHM of a HiLo sectioning curve varies inversely with σw, as confirmed by experiment. Thus the thickness of a HiLo optical section is linearly proportional to σw1 [Fig. 3]. Since W(κ) is applied only post-acquisition, the same pair of raw images can be used to generate many different HiLo images of varying axial thicknesses. This unique property of HiLo microscopy is illustrated in Fig. 3, where the dashed lines indicate different sectioning curves derived from the same raw data. However, the selection of σw has repercussions on exactly how we must fuse the low and high frequency image content in I LP and I HP . Indeed, by adjusting W(κ), we are adjusting the axial thickness of I LP only. To ensure that the axial thickness of I HP is commensurate with that of I LP , we must also adjust the cutoff frequency separating these. The relationship between the axial resolution of I HP and its spatial frequency content is described by the 3-D OTF of a wide-field microscope, which can be approximated by an empirically derived expression known as the Stokseth approximation.15 Based on this approximation, we find that the cutoff frequency separating I LP and I HP should be set to approximately 0.18σw.

Thus, the axial resolution (depth of field) of HiLo microscopy can be tuned a posteriori by varying a single parameter:

σw
. We demonstrate such tuning in 2, in which the same raw uniform and speckle images are processed into optically sectioned HiLo images of varying thicknesses. It should be noted that while a thinner optical section results in better image contrast, a loss of depth of field is not always desirable. This can be a problem, for example, in confocal microscopy where the user is constrained to a fixed depth of field for a given objective and pinhole size. While the depth of field in confocal microscopy can be increased by using a larger pinhole, such a solution is usually unappealing since it leads to poorer lateral resolution and requires the acquisition of new data. In contrast, the lateral resolution of a HiLo microscope is independent of σw, meaning no such trade-off between depth of field and lateral resolution is required.

We have demonstrated that HiLo microscopy provides 3-D imaging comparable to confocal microscopy; however, key performance requirements for biological imaging are not just image quality but also speed and FOV. These last two requirements are particularly important when imaging large, dynamic samples, such as live animal models. In addition to the planaria models shown in 2, we demonstrate in vivo HiLo imaging in other commonly studied animal models, namely C. elegans and zebrafish. These not only illustrate the versatility of HiLo microscopy, but also further highlight some of its advantages over confocal microscopy.

To begin, C. elegans are especially well-suited for imaging applications because they are optically transparent and can be readily studied fully intact. For example, due to its simplicity, the C. elegans nervous system is well-characterized with each neuron identifiable by position. Yet despite the benefits of optical sectioning conferred by scanning techniques such as confocal or TPEF microscopy, C. elegans are most often imaged with conventional wide-field microscopes for ease of use and generally superior imaging speed.19 HiLo microscopy provides a useful alternative to such conventional wide-field techniques, offering both the advantages of (tunable) optical sectioning and high imaging speed.

3 shows live C. elegans in an agarose gel. The worms are labeled by cameleon, a genetically encoded calcium indicator consisting of both a cyan fluorescent protein (CFP) and yellow fluorescent protein (YFP).20 While cameleon indicators are normally used with YFP/CFP ratiometric imaging, we look only at the CFP emission here and the cameleon serves only as a fluorescent neuron labeler. The labeled neurons are motorneurons found mostly along the body but also in the head and tail. The HiLo images demonstrate a marked improvement in contrast over the conventional wide-field images (note the relative absence of fluorescence background generated from the thick agarose gel). Moreover, despite the rapid motion of the C. elegans, motion artifacts are largely absent in the HiLo images owing to the short camera exposure times (2×60 ms), moderately high frame rate (net 7 Hz) and simultaneous acquisition of all pixels across the FOV (3).

High resolution in vivo imaging typically poses a number of challenges in addition to a requirement of speed. For example, a wide FOV is often desirable for the study of long range cellular dynamics. As will be discussed below, wide FOV imaging is particularly difficult to achieve with standard confocal microscopy. HiLo microscopy, however, is entirely compatible with wide FOV imaging. To demonstrate this, our home-built setup was designed to accommodate, besides conventional objectives, a macroscope objective that provides a large FOV and a large working distance, while maintaining high collection efficiency and resolution. Such a macroscope configuration was used in the in vivo imaging of planaria (2) and zebrafish (4).

Zebrafish are a common choice of animal model for the study of vertebrate development, again largely because of their relative optical transparency. While this property of transparency was previously limited to developing zebrafish, a mutant line casper has been introduced that exhibits almost entirely transparent adult bodies.21 We imaged live zebrafish (7 post-fertilization) with EGFP labeling driven by a CD41 promoter. Time-lapse imaging of such zebrafish are used in hematopoiesis studies to monitor the dynamics of CD41-low and CD41-high cells.23 The suppression of background fluorescence (4) highlights EGFP-positive cells including thrombocytes and caudal hematopoietic tissue, which appear as circulating and static structures, respectively, in the video. Once again, we emphasize that motion artifacts are observed here to be minimal and that the FOV (2.2×2.2

mm 2
) is much larger than could be attained with conventional confocal microscopy.

We have demonstrated that HiLo microscopy is capable of producing optically sectioned images comparable in quality to a commercial confocal microscope. This is achieved by processing two images, one taken with speckle illumination and another with conventional uniform illumination. An immediate advantage of this acquisition scheme is that for every background-free HiLo image, the corresponding standard wide-field image is also available. Indeed, we have shown that by choice of a single post-processing parameter, the user can tune the level of background-rejection from confocal-like to completely unsectioned.

Because the raw images are acquired in wide-field mode, the limiting factors to speed are generally frame rate and illumination power. Randomization of the speckle by the galvanometer is currently not a limiting factor, since this has proven to be fast and reliable, producing stable performance at acquisition speeds beyond 50 fps. The numerical processing of images with our HiLo algorithm is also not a limiting factor, and is done in real time (see Sec. 3). Our prototype HiLo microscope currently operates at a speed of 7 fps (for 600×600 images), limited by the frame rate of our CCD camera. In principle, given sufficient illumination power, HiLo microscopy should be able to operate at half the frame rate of even faster cameras. A faster camera would lead not only to faster imaging but also to a reduction in potential motion artifacts. Ideally, the two raw images should be acquired on a time scale more rapid than the sample dynamics of interest. However, even when this is not the case, HiLo microscopy remains fairly resistant to motion artifacts since all the high spatial-frequency information, in which motion is mostly captured, is extracted solely from the single image

Iu
. This is a significant departure from SIM, wherein high spatial frequency information becomes equally distributed among three raw images, leading to a greater susceptibility to motion artifacts.12 Because HiLo microscopy requires only two raw images, it can also conveniently be used with a double-shutter camera (commonly used for particle image velocimetry) to further reduce the time lapse between the recordings of Iu and Is.

For comparison, frame rates beyond 1 Hz in confocal microscopy generally require complex scanning mechanisms. For example, one configuration involves the use of a Nipkow disk to rapidly scan the illumination beam (or beamlets) across the sample. This can suffer from poor light efficiency and cross-talk between the multiple pinholes.1 Another approach involves the use of resonant galvanometer mirrors. Such mirrors utilize open-loop control and are capable of faster scan speeds than their closed-loop kindred. However, the trade-off is a loss of control of the scan speed that results in nonuniform sampling.22 Yet another strategy replaces the galvanometer-based scanning system with a rotating polygonal mirror capable of very high scan speeds at the cost of pointing precision.23 In the end, because of the technical complexities involved in fast imaging, the benefits of confocal microscopy are often trumped by the simple convenience of standard wide-field imaging with high frame rate CCD or CMOS cameras, which have the advantage of simultaneous sampling across the entire FOV.

With regard to FOV, this too can be compared between HiLo and confocal microscopy. Since the illumination beam is scanned in a confocal microscope, an increase in FOV would require not only an increase in scan range but also an expansion of the beam width to accommodate the large aperture of typical macroscope objectives. The requirements of large scan range and large beam expansion are inherently incompatible and impossible to achieve with standard galvonometer-based scanners, and prescribe instead the use of large galvonometer mirrors that would inevitably compromise imaging speed. Thus, in practice, fast confocal microscopes are typically limited to FOV’s less than 0.5

mm 2
. As we have shown here, much larger FOV’s can be readily achieved with HiLo imaging with minimal setup modifications. In this regard, HiLo imaging should prove to be especially useful in applications such as intravital microscopy,24 which would benefit from fast, optically sectioned imaging with large FOV’s.

However, HiLo microscopy also has drawbacks compared to confocal microscopy. Specifically, background is rejected by a physical pinhole in confocal microscopy, whereas in HiLo microscopy (as in any post-processing technique such as SIM or PAM), it is rejected only numerically. As a result, the cameras used in HiLo microscopy must possess a higher dynamic range than required for confocal microscope detectors. Moreover, any shot noise associated with the background, while absent in confocal microscopy, must be corrected for in HiLo microscopy (albeit imperfectly — only a bias resulting from the shot noise can be corrected and not the random variations about this bias). Despite these drawbacks of post processing, HiLo microscopy remains nevertheless competitive with confocal microscopy, and, in many cases, advantageous, as shown above.

The crux of HiLo microscopy lies in the extraction of detected illumination contrast to distinguish in-focus signal from out-of-focus background. It should be noted that the source of illumination contrast is not limited to speckle. HiLo microscopy can be operated with essentially any high contrast pattern. For example, HiLo microscopy has been demonstrated with grid illumination in both an endomicroscope setup,12 and in conjunction with light-sheet illumination.13 While this freedom of choice of illumination patterns opens the possibility of using incoherent light sources, the benefits of coherent speckle illumination remain incontrovertible. The generation of speckle illumination is effortless as it requires essentially no imaging optics. Moreover, by dint of its being coherent, speckle retains its exceptionally high contrast completely independent of tissue scattering or aberrations. As such, HiLo microscopy with speckle illumination is simple, robust, and versatile. These qualities make HiLo microscopy useful for a broad array of bioimaging applications.

This was was supported by the NIH ( UNSPECIFIED R01 EB010059 ), the Coulter Foundation, and the Boston University Photonics Center. The authors thank Jinhyun Kim, Gal Haspel, and Dongdong Ma for providing samples.

Pawley  J. B.,  Handbook of Biological Confocal Microscopy. ,  Springer ,  Berlin  ((2006)).
Denk  W., , Strickler  J. H., , and Webb  W. W., “ Two-photon laser scanning fluorescence microscopy. ,” Science. 248, , 73–76  ((1990)).
Neil  M. A. A., , Wilson  T., , and Juskaitis  R. “ Methods of obtaining optical sectioning by using structured light in a conventional microscope. ,” Opt. Lett.. 22, , 1905–1907  ((1997)).
Verveer  P. J., , Hanley  Q. S., , Verbeek  P. W., , van Vliet  L. J., , and Jovin  T. M. “ Theory of confocal fluorescence imaging in the programmable array microscope. (PAM). ,” J. Microsc.. 189, 195–198  ((1998)).
Huisken  J., Swoger  J., , Del Bene  F., , Wittbrodt  J., , and Stelzer  E. H. K. “ Optical sectioning deep inside live embryos by selective plane illumination microscopy. ,” Science. 305, , 1007–1009  ((2004)).
Dodt  H.-U., , Leischner  U., , Schierloh  A., , Jährling  N., , Mauch  C. P., , Deininger  K., , Deussing  J. M., , Eder  M., , Zieglgänsberger  W., , and Becker  K., “ Ultramicroscopy: three-dimensional visualization of neuronal networks in the whole mouse brain. ,” Nat. Methods. 4, , 331–336  ((2007)).
Ventalon  C., and Mertz  J., “ Quasi-confocal fluorescence sectioning with dynamic speckle illumination. ,” Opt. Lett.. 30, , 3350–3352  ((2005)).
Ventalon  C., and Mertz  J. “ Dynamic speckle illumination microscopy with translated versus randomized speckle patterns. ,” Opt. Exp.. 14, , 7198–7209  ((2006)).
Ventalon  C., , Heintzmann  R., , and Mertz  J. “ Dynamic speckle illumination microscopy with wavelet prefiltering. ,” Opt. Lett.. 32, , 1417–1419  ((2007)).
Goodman  J. W.,  Speckle Phenomena in Optics. ,  Roberts and Company Publishers  ((2006)).
Lim  D., , Chu  K. K., , and Mertz  J., “ Wide-field fluorescence sectioning with hybrid speckle and uniform-illumination microscopy. ,” Opt. Lett.. 33, , 1819–1821  ((2008)).
Santos  S., , Chu  K. K., , Lim  D., , Bozinovic  N., , Ford  T. N., , Hourtoule  C., , Bartoo  A. C., , Singh  S. K., , and Mertz  J., “ Optically sectioned fluorescence endomicroscopy with hybrid-illumination imaging through a flexible fiber bundle. ,” J. Biomed. Opt.. 14, , 030502  ((2009)).
Mertz  J., and Kim  J. “ Scanning light-sheet microscopy in the whole mouse brain with HiLo background rejection. ,” J. Biomed. Opt.. 15, , 016027  ((2010)).
Leushacke  L., and Kirchner  M. “ Three-dimensional correlation coefficient of speckle intensity for rectangular and circular apertures. ,” J. Opt. Soc. Am. A. 7, , 827–832  ((1990)).
Stokseth  P., “ Properties of a defocused optical system. ,” J. Opt.. 59, , 1314–1321  ((1969)).
Mertz  J.,  Introduction to Optical Microscopy. ,  Roberts and Company Publishers  ((2009)).
Navarro-Quiroga  I., , Chittajalu  R., , Gallo  V., , and Haydar  T. F., “ Long-term, selective gene expression in developing and adult hippocampal pyramidal neurons using focal in utero electroporation. ,” J. Neurosci.. 27, , 5007–5011  ((2007)).
Sheppard  C. J. R., , Gu  M., , Brain  K., , and Zhou  H. “ Influence of spherical aberration on axial imaging of confocal reflection microscopy. ,” Appl. Opt.. 33, , 616–624  ((1994)).
Kerr  R., , Lev-Ram  V., , Baird  G., , Vincent  P., , Tsien  R. Y., , and Schafer  W. R., “ Optical imaging of calcium transients in neurons and pharyngeal muscle of C. elegans. ,” Neuron. 26, , 583–594  ((2000)).
Miyawaki  A., , Griesbeck  O., , Heim  R., , and Tsien  R. Y., “ Dynamic and quantitative Ca2+ measurements using improved cameleons. ,” Proc. Natl. Acad. Sci. U.S.A.. 96, , 2135–2140  ((1999)).
White  R. M., , Sessa  A., , Burke  C., , Bowman  T., , LeBlanc  J., , Ceol  C., , Bourque  C., , Dovey  M., , Goessling  W., , Burns  C. E., , and Zon  L. I., “ Transparent adult zebrafish as a tool for in vivo transplantation analysis. ,” Cell Stem Cell. 2, , 183–189  ((2008)).
Marshall  G. F., Ed.,  Handbook of Optical and Laser Scanning. ,  Marcel Dekker Inc. ,  New York  ((2009)).
Lin  H.-F., , Traver  D., , Zhu  H., , Dooley  K., , Paw  B. H., , Zon  L. I., , and Handin  R. I., “ Analysis of thrombocyte development in CD41-GFP transgenic zebrafish. ,” Blood. 106, , 3803–3810  ((2005)).
Jain  R. K., , Munn  L. L., , and Fukumura  D. “ Dissecting tumour pathophysiology using intravital microscopy. ,” Nature Rev. Cancer. 2, , 266–276  ((2002)).
© 2011 Society of Photo-Optical Instrumentation Engineers (SPIE)

Citation

Daryl Lim ; Tim N. Ford ; Kengyeh K. Chu and Jerome Mertz
"Optically sectioned in vivo imaging with speckle illumination HiLo microscopy", J. Biomed. Opt. 16(1), 016014 (January 31, 2011). ; http://dx.doi.org/10.1117/1.3528656


Figures

Grahic Jump LocationF1 :

A HiLo microscope setup is identical to a standard wide-field epi-fluorescence microscope except for the addition of a laser beam and diffuser in the illumination path, resulting in speckle illumination at the sample. The resulting fluorescence is captured by a digital camera. When the diffuser is static, the speckle illumination exhibits high contrast (top right panel). When the diffuser is rapidly oscillated by a galvanometric motor, the resulting speckle becomes blurred over the course of the camera exposure, effectively simulating uniform illumination (bottom right panel). Speckle and uniform illumination images are acquired pairwise, and processed into an optically sectioned HiLo image.

Grahic Jump LocationF2 :

Volumetric imaging of a mouse brain hippocampus slice (100 μm thick) labeled by cytoplasmic EGFP by in utero electroporation.17z-stacks comprising 200 slices with 0.5 μm step size were acquired with a HiLo microscope and a commercial confocal microscope (Olympus FluoView 1000), in both cases using a 20× water immersion objective (Olympus UApo/340). Co-located z-slices (single frames) presented in the left column were taken with (a) standard wide-field microscopy; (b) HiLo microscopy; and (c) confocal microscopy. HiLo exposure time was 2×400 ms per slice (power limited with an illumination power at the sample of about 4 mW), with images acquired at 1200×1200 resolution. Confocal exposure time was 2880 ms per slice (scan speed limited). Scale bar is 50 μm.

Grahic Jump LocationF3 :

(a) Confocal sectioning curve (solid red line) and HiLo sectioning curves processed with different

σw ’s (solid blue and dashed lines) using the same data. (b) Bandpass filters used to generate HiLo sectioning curves (solid blue and dashed lines). Solid black line depicts the magnitude of the in-focus detection OTF for comparison. (c) FWHM (averaged over nine measurements) of HiLo sectioning curves as a function of σw1. Dashed cyan line indicates a linear fit (R2=0.998).

Tables

References

Pawley  J. B.,  Handbook of Biological Confocal Microscopy. ,  Springer ,  Berlin  ((2006)).
Denk  W., , Strickler  J. H., , and Webb  W. W., “ Two-photon laser scanning fluorescence microscopy. ,” Science. 248, , 73–76  ((1990)).
Neil  M. A. A., , Wilson  T., , and Juskaitis  R. “ Methods of obtaining optical sectioning by using structured light in a conventional microscope. ,” Opt. Lett.. 22, , 1905–1907  ((1997)).
Verveer  P. J., , Hanley  Q. S., , Verbeek  P. W., , van Vliet  L. J., , and Jovin  T. M. “ Theory of confocal fluorescence imaging in the programmable array microscope. (PAM). ,” J. Microsc.. 189, 195–198  ((1998)).
Huisken  J., Swoger  J., , Del Bene  F., , Wittbrodt  J., , and Stelzer  E. H. K. “ Optical sectioning deep inside live embryos by selective plane illumination microscopy. ,” Science. 305, , 1007–1009  ((2004)).
Dodt  H.-U., , Leischner  U., , Schierloh  A., , Jährling  N., , Mauch  C. P., , Deininger  K., , Deussing  J. M., , Eder  M., , Zieglgänsberger  W., , and Becker  K., “ Ultramicroscopy: three-dimensional visualization of neuronal networks in the whole mouse brain. ,” Nat. Methods. 4, , 331–336  ((2007)).
Ventalon  C., and Mertz  J., “ Quasi-confocal fluorescence sectioning with dynamic speckle illumination. ,” Opt. Lett.. 30, , 3350–3352  ((2005)).
Ventalon  C., and Mertz  J. “ Dynamic speckle illumination microscopy with translated versus randomized speckle patterns. ,” Opt. Exp.. 14, , 7198–7209  ((2006)).
Ventalon  C., , Heintzmann  R., , and Mertz  J. “ Dynamic speckle illumination microscopy with wavelet prefiltering. ,” Opt. Lett.. 32, , 1417–1419  ((2007)).
Goodman  J. W.,  Speckle Phenomena in Optics. ,  Roberts and Company Publishers  ((2006)).
Lim  D., , Chu  K. K., , and Mertz  J., “ Wide-field fluorescence sectioning with hybrid speckle and uniform-illumination microscopy. ,” Opt. Lett.. 33, , 1819–1821  ((2008)).
Santos  S., , Chu  K. K., , Lim  D., , Bozinovic  N., , Ford  T. N., , Hourtoule  C., , Bartoo  A. C., , Singh  S. K., , and Mertz  J., “ Optically sectioned fluorescence endomicroscopy with hybrid-illumination imaging through a flexible fiber bundle. ,” J. Biomed. Opt.. 14, , 030502  ((2009)).
Mertz  J., and Kim  J. “ Scanning light-sheet microscopy in the whole mouse brain with HiLo background rejection. ,” J. Biomed. Opt.. 15, , 016027  ((2010)).
Leushacke  L., and Kirchner  M. “ Three-dimensional correlation coefficient of speckle intensity for rectangular and circular apertures. ,” J. Opt. Soc. Am. A. 7, , 827–832  ((1990)).
Stokseth  P., “ Properties of a defocused optical system. ,” J. Opt.. 59, , 1314–1321  ((1969)).
Mertz  J.,  Introduction to Optical Microscopy. ,  Roberts and Company Publishers  ((2009)).
Navarro-Quiroga  I., , Chittajalu  R., , Gallo  V., , and Haydar  T. F., “ Long-term, selective gene expression in developing and adult hippocampal pyramidal neurons using focal in utero electroporation. ,” J. Neurosci.. 27, , 5007–5011  ((2007)).
Sheppard  C. J. R., , Gu  M., , Brain  K., , and Zhou  H. “ Influence of spherical aberration on axial imaging of confocal reflection microscopy. ,” Appl. Opt.. 33, , 616–624  ((1994)).
Kerr  R., , Lev-Ram  V., , Baird  G., , Vincent  P., , Tsien  R. Y., , and Schafer  W. R., “ Optical imaging of calcium transients in neurons and pharyngeal muscle of C. elegans. ,” Neuron. 26, , 583–594  ((2000)).
Miyawaki  A., , Griesbeck  O., , Heim  R., , and Tsien  R. Y., “ Dynamic and quantitative Ca2+ measurements using improved cameleons. ,” Proc. Natl. Acad. Sci. U.S.A.. 96, , 2135–2140  ((1999)).
White  R. M., , Sessa  A., , Burke  C., , Bowman  T., , LeBlanc  J., , Ceol  C., , Bourque  C., , Dovey  M., , Goessling  W., , Burns  C. E., , and Zon  L. I., “ Transparent adult zebrafish as a tool for in vivo transplantation analysis. ,” Cell Stem Cell. 2, , 183–189  ((2008)).
Marshall  G. F., Ed.,  Handbook of Optical and Laser Scanning. ,  Marcel Dekker Inc. ,  New York  ((2009)).
Lin  H.-F., , Traver  D., , Zhu  H., , Dooley  K., , Paw  B. H., , Zon  L. I., , and Handin  R. I., “ Analysis of thrombocyte development in CD41-GFP transgenic zebrafish. ,” Blood. 106, , 3803–3810  ((2005)).
Jain  R. K., , Munn  L. L., , and Fukumura  D. “ Dissecting tumour pathophysiology using intravital microscopy. ,” Nature Rev. Cancer. 2, , 266–276  ((2002)).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

PubMed Articles
Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.