Research Papers: Imaging

Automated three-dimensional registration and volume rebuilding for wide-field angiographic and structural optical coherence tomography

[+] Author Affiliations
Pengxiao Zang

Oregon Health and Science University, Casey Eye Institute, Portland, Oregon, United States

Shandong Normal University, Shandong Province Key Laboratory of Medical Physics and Image Processing Technology, Institute of Biomedical Sciences, School of Physics and Electronics, Jinan, Shandong, China

Gangjun Liu, Miao Zhang, Jie Wang, Thomas S. Hwang, David J. Wilson, David Huang, Yali Jia

Oregon Health and Science University, Casey Eye Institute, Portland, Oregon, United States

Dengwang Li

Shandong Normal University, Shandong Province Key Laboratory of Medical Physics and Image Processing Technology, Institute of Biomedical Sciences, School of Physics and Electronics, Jinan, Shandong, China

J. Biomed. Opt. 22(2), 026001 (Feb 01, 2017). doi:10.1117/1.JBO.22.2.026001
History: Received November 9, 2016; Accepted January 9, 2017
Text Size: A A A

Open Access Open Access

Abstract.  We propose a three-dimensional (3-D) registration method to correct motion artifacts and construct the volume structure for angiographic and structural optical coherence tomography (OCT). This algorithm is particularly suitable for the nonorthogonal wide-field OCT scan acquired by a ultrahigh-speed swept-source system (>200  kHz A-scan rate). First, the transverse motion artifacts are corrected by the between-frame registration based on en face OCT angiography (OCTA). After A-scan transverse translation between B-frames, the axial motions are corrected based on the rebuilt boundary of inner limiting membrane. Finally, a within-frame registration is performed for local optimization based on cross-sectional OCTA. We evaluated this algorithm on retinal volumes of six normal subjects. The results showed significantly improved retinal smoothness in 3-D-registered structural OCT and image contrast on en face OCTA.

Figures in this Article

Optical coherence tomography (OCT) uses interferometric analysis of low-coherence light to provide depth-resolved micrometer-resolution images of tissue, such as retina and optic nerve head.1 Clinically, both cross-sectional (B-frame) and three-dimensional (3-D) structural OCT are useful for detecting and monitoring anatomic alterations. With the increase of OCT imaging speed,2,3 an OCT angiography (OCTA) technique was developed.414 Multiple B-frames can be taken on the same position, and the changes of OCT reflectance properties can be measured to differentiate vasculature from static tissues. These B-frames can also be averaged to generate structural OCT images.

Multiple B-frames taken in the slow transverse direction can create a volumetric scan. A single volumetric scan usually takes 3 to 5 s, during which involuntary eye movements, such as microsaccades and saccades, can introduce motion artifacts.1517 They appear as discontinuities on the en face projection of OCT volume and bright lines (saturated signals) on the en face OCTA. These large and rapid eye motions on the transverse direction can be mitigated by adding retinal tracking modality, such as scanning laser ophthalmoscope and infrared fundus video camera that can detect image shifts, pause the OCT scan, and then resume the scan at the proper position.1823 Eye tracking strategy can reduce the discontinuities on en face images, but it cannot correct mild transverse or any axial motion. The remaining motion artifacts show as bright lines on en face OCTA. Therefore, additional processing is required to eliminate these lines.

Two-dimensional (2-D) registration algorithms have been developed to reduce motion in en face OCTA—one using the orthogonal method (registration of x-fast and y-fast en face angiograms)24 and one using the parallel method (registration of two y-fast en face angiograms).25 These methods are simple and fast. However, they cannot correct motion on volumetric data, and the distortion of angiographic and structural B-frames on slow axis cannot be removed. Correction of motion artifacts on the volumetric data not only provides clinically useful cross-sectional images along slow axis but also improves the segmentation efficiency on retinal layers. In addition, a motion-corrected OCT volume can improve volume rendering of the retinal vasculature, the optic disc, and the fovea.

One successful algorithm for motion correction on OCT volume is the 3-D orthogonal method.26 It combines the information in x-fast and y-fast volumetric raster scans and registered A-scans individually by finding a 3-D motion field that minimizes an energy function. This algorithm has been adopted in the commercial Avanti OCT system (Optovue, Inc., Fremont, California) to register angiographic and structural OCT data by detecting the motions calculated from 3-D structural OCT. Although this technology greatly improves the merged scan quality, residual lines can still persist on OCTA.

In this study, we propose a 3-D registration algorithm for OCT volume based on both angiographic and structural OCT information. The vasculature on en face retinal OCTA is used for transverse registration, and the inner limiting membrane (ILM) boundary on structural OCT is taken as the reference for axial registration. Building on our previous work on parallel registration suitable for the ultrahigh-speed OCT (above 200 kHz), this algorithm will provide a comprehensive registration system for automated volume rebuilding in wide-field angiographic and structural OCT.

Study Population

This study was conducted at the Casey Eye Institute, the Oregon Health and Science University. The study adhered to the tenets of the Declaration of Helsinki and was approved by the Institutional Review Board. Six healthy participants (aged 35±4  years) were recruited for the study.

Image Acquisition

A 200-kHz prototype swept-source OCT system was used in this study. The source laser had a center wavelength of 1045 nm and a tuning range of 100  nm (Axsun Technologies Inc., Billerica, Massachusetts). A dual-balanced detector (PDB471C, Thorlabs Inc.) converted the optical signal to electrical signal, and a high-speed digitizer (ATS 9360, Alazar Technologies Inc., Pointe-Claire, Quebec) acquired the electrical signal. The resulting system had an axial resolution of 7.5  μm in air, a lateral resolution of 12  μm, and an extended axial imaging range of 7 mm. The light exposure at the cornea was 1.4 mW, within the American National Standards Institute safety limit.27

Two 6×10×7 (x×y×z) mm volumetric y-fast scans were captured at the same region of posterior pole including the macula and the disc in each eye. Each volume consisted of 800 B-frames, composed of a set of 850 A-lines acquired twice at each of the 400 raster positions. This yielded a lateral sampling density of 11.8  μm along the fast transverse scan axis and 15.0  μm along the slow axis. One volumetric scan was acquired in approximately 4 s.

Structural OCT data were obtained by averaging the two B-frames acquired at the same raster position. The split-spectrum amplitude-decorrelation angiography algorithm4 was used to calculate OCTA data. The boundaries of ILM and outer plexiform layer (OPL) were detected on each B-frame by directional graph search method.28 The en face retinal angiogram was generated by using the maximum decorrelation value along the axial direction within a slab between ILM and OPL.

Volumetric Registration Algorithm

This proposed method is composed of four main steps (Fig. 1). First, the transverse motion artifacts on en face retinal OCTA are corrected by an affine registration algorithm on the parallel microsaccade-free strips. This step corrects the motion artifacts between B-frames caused by translational, rotational, and focusing differences (Fig. 2).25 Each A-line of reflectance and decorrelation signal in the volumetric OCT is translated based on the transformation matrix of the corresponding strip. Then, the ILM boundaries on the new transformed slow axis B-frames at the same position in each volume are averaged and smoothed to recover a motion-free ILM boundary. Based on this new boundary, each pair of A-line was initially registered along the axial direction at each B-frame. The final axial position of each A-line was fine-tuned by correlation of reflectance of each pair of A-line. Next, a registration based on cross-sectional OCTA was applied between each pair of fast axis B-frame to refine the final transverse position of each A-line. Lastly, two volumes of structural OCT and OCTA were averaged and merged, respectively, to produce the final motion-corrected volumes.

Graphic Jump Location
Fig. 1
F1 :

The flow chart of the 3-D registration and volume rebuilding algorithm.

Graphic Jump Location
Fig. 2
F2 :

The schematic diagram of the between-frame registration process between two y-fast volumetric scans. (a) First en face OCTA. The white vertical line artifacts are caused by microsaccadic bulk motion. (b) Second en face OCTA. (c, d) The microsaccadic line artifacts are detected and removed, leaving intermicrosaccadic strips for registration. (e) The merged en face OCTA after affine registration of the strips.

Between-frame registration

We first detected and removed the large motion artifacts shown as bright lines on en face OCTA. The algorithm detected these bright line artifacts as projected B-frames with summed flow signal above the threshold, set as 2.3 standard deviations above the mean. Then en face angiogram was divided into microsaccade-free strips at the detected motion lines [Figs. 2(c) and 2(d)]. We initiated the registration process on two strips, one from each scan that contains the largest overlap. Using the larger of the two strips as the reference strip and the other as the moving strip, we applied the affine registration algorithm. It utilizes a gradient descent to search for a similarity transformation, which allows translation, scaling, rotation, and skewing within the transverse (x-y) plane. The goal is to find a transformation of the moving strip that minimizes the squared difference of the reference vasculature and transformed moving vasculature Display Formula

Cbetween(t)=x,y{Vr(x,y)Vm[T(x,y;t)]}2,(1)
where (x,y) is the pixel coordinate, t is a vector of transformation parameters, Vr(x,y) is the reference vasculature, Vm(x,y) is the moving vasculature, and T is the transformation matrix. This minimization can be solved iteratively. The new registered and merged strip was then defined as the new reference strip and the strip with the largest overlap with the new reference strip as the new moving strip. The process was repeated until all strips were registered and merged into one comprehensive en face OCTA image [Fig. 2(e)].

This step provides the transverse transform matrix. Each A-line of the first and second volumetric structural OCT and OCTA was translated, and the between-frame transformation was completed.

Rebuilding of the inner limiting membrane boundary

Next, the ILM boundary was rebuilt by merging and smoothing ILM boundaries on two transformed volumetric structural OCT.28 This rebuilding process was performed in the slow axis and included three steps: first, a pair of slow axis ILM boundaries from each volume was adjusted to the closest position [Figs. 3(a) and 3(b)]. In this step, the ILM boundary from the reference volume is the reference boundary Br, and the ILM boundary from the moving volume is the moving boundary Bm0. The newly moved boundary Bm was obtained when the moving boundary adjusted to the closest position to the reference boundary based on the below equation: Display Formula

Bm(x)=Bm0(x)+tx=1,2,,LE=i=1L|Br(i)Bm(i)|Br(i)>0,Bm(i)>0t*=argmin(E|t)t[100,100],(2)
where t is the displacement of the Bm0(x), E is the cost function, L is the number of the A-line in corresponding slow axis B-frame, and the optimized displacement t* is selected when the cost function E achieves the smallest value. The height profiles of reference boundary and the moved boundary were averaged to generate the initial merged ILM boundary Bave [Fig. 3(c)] Display Formula
Bave=(Br+Bm)/2.(3)

Graphic Jump Location
Fig. 3
F3 :

The rebuilding process of the ILM boundary height profile along the x (slow)-axis. (a) The original reference (red) and moving (yellow) boundaries. (b) The transformed moving boundary (yellow) is translated to match the reference boundary (red) in average height. (c) The average height profile (green) of the reference (red) and transformed moving (yellow) boundary. (d) The average height profile is smoothed using a moving average filter to obtain the final ILM boundary (green).

Then, the final rebuilt ILM boundary of this B-frame was obtained after a smooth process on BaveDisplay Formula

Brebuilt={Brebuilt(n)=Bave(1)++Bave(n)++Bave(n+n1)n[1,sp]Brebuilt(n)=Bave(nsp)++Bave(n)++Bave(n+sp)n[sp+1,Lsp]Brebuilt(n)=Bave[n(Ln)]++Bave(n)++Bave(L)n[Lsp+1,L]sp=L/20,(4)
where sp is the smooth parameter and means round down [Fig. 3(d)].

Axial registration

After the rebuilt, the ILM boundary was obtained, and each A-line of two OCT and OCTA volumes was translated based on the displacement between Brebuilt and corresponding ILM boundary Display Formula

Dr(x,y)=Brebuilt(x,y)Br(x,y)Dm(x,y)=Brebuilt(x,y)Bm(x,y),(5)
where Dr(x,y) and Dm(x,y) are the displacement of each A-line in reference and moving volumes, respectively, and (x,y) is the coordinate of each A-line. Each A-line was then translated based on the corresponding displacements. To reduce the registration error caused by ILM segmentation, another registration between these two A-lines was applied to fine-tune the axial final positions. Before the registration, the reflectance of two A-lines [Figs. 4(a) and 4(b)] was first normalized to [0, 1] and filtered by a 1×Nz pixel Gaussian filter with 5 pixel standard deviation [Fig. 4(c)]. The registration was optimized by a cost function C(p)Display Formula
C(p)=1Nzz=1,2,,Nz[Ar(z)Am(z+p)]2p=[10,10],(6)
where C(p) is the cost function of the registration, Ar(z) is the normalized reflectance of the reference A-line, Am(z+p) is the normalized reflectance of the moving A-line after a displacement p, and Nz is the number of pixel in each A-line. The optimized displacement P* was selected when the cost function C(p) achieved the smallest value. In the final axial registration step, Ar(z) and Am(z) were translated to Ar[z(p*p*/2)] and, respectively, [Fig. 4(d)].

Graphic Jump Location
Fig. 4
F4 :

The axial registration process. (a) The reference A-line of the normalized reflectance signal (red). (b) The moving A-line of the normalized reflectance signal (green). (c) The reference and moving A-line low-pass filtered by the Gaussian function. (d) The moving and reference A-line were registered by minimizing their sum squared difference and shifted to their mean position.

Within-frame registration

To further improve the transverse registration accuracy, a within-frame registration based on the cross-sectional decorrelation signal profile was performed.

The decorrelation signal on each pair of B-frames along y (fast)-axis was registered by an affine registration (Fig. 5). Since there were just some small distortions between two initially registered volumes, the ranges of translation, scale, rotation, and skew were limited to |translation|<5, |scale100%|<5%, |rotation|<2  deg, and |skew90  deg|<3  deg.

Graphic Jump Location
Fig. 5
F5 :

An example of the within-frame registration between a pair of OCTA B-frames. (a) The reference B-frame (flow signal in red). (b) The moving B-frame (green). (c) The moving B-frame is overlaid on the reference B-frame without registration. (d) The two B-frames after affine registration to minimize sum squared difference. The enlarged regions are outlined in blue. (e) Enlargement of panel c showing mismatch in the position of two large vessels (blue arrows). (f) Enlargement of panel d showing registration of the two mismatched vessels.

After the within-frame registration, the final merged volumetric scans were obtained by averaging two registered OCT and OCTA together. A postprocessing, including Gabor filter and multiscale vessel enhancement filter, was performed to improve the image quality of the en face OCTA.29,30

The automated volumetric registration of two scans took an average of 7 min. The test was performed on a workstation with Inter(R) Xeon(R) CPU E3-1226 v3 at 3.30 GHz and 16.0 GB RAM using MATLAB® 2014b (Mathworks, Natick, Massachusetts).

Figure 6 shows the registration results of two y-fast scans on central macula. The volumetric rendering of the scan volumes (first row) before and after motion correction shows the surface ripples due to axial motion on the original y-fast volume [Figs. 6(a) and 6(b)]. The correction recovers the smoothness of volume surface [Fig. 6(c)]. B-frames on slow axis, seen on the second row, also show the performance of axial registration. The microsaccades along axial direction distort the retinal and choroidal layers in the original B-frames [Figs. 6(d) and 6(e)]. Axial registration recovers the smooth boundaries of retina and choroid, including the outer boundary of the choroid [Fig. 6(f)]. No motion artifact is shown on B-frames along the y (fast)-axis [Figs. 6(g) and 6(h)] due to the high A-line rate on the vertical priority. Our results show no registration error is introduced on fast axis in the merged B-frame [Fig. 6(i)], although the axial registration is performed on the slow axis. In addition, the transverse motion artifacts and the vasculature incoherence are all corrected on OCTA [Figs. 6(j)6(l)].

Graphic Jump Location
Fig. 6
F6 :

3-D registration of two y-fast volumetric OCT and OCTA (6×10×7  mm) of macular region on a normal eye: (a) first volumetric OCT, (b) second volumetric OCT, (c) merged volumetric OCT after the 3-D registration of a and b, (d) the B-frame along x (slow)-axis in first volume (red line in j), (e) the B-frame along x-axis in second volume (red line in k), (f) the B-frame along x-axis in the merged volume (red line in l), (g) the B-frame along y (fast)-axis in first volume (yellow line in j), (h) the B-frame along y-axis in second volume (yellow line in k), (i) the B-frame along y-axis in the merged volume (yellow line in l), (j) first en face OCTA, (k) second en face OCTA, and (l) the merged en face OCTA after 3-D registration of two volumes.

Figure 7 shows that the registered and merged structural B-frame on slow axis crossing fovea mimics the B-frame acquired by x-fast scan on the same position of the same eye, indicating that the axial registration based on ILM boundary rebuilding on slow axis resembles the anatomic retinal contour.

Graphic Jump Location
Fig. 7
F7 :

(a) A comparison of the slow axis B-frame of the merged OCT and (b) the x-fast B-frame crossing the fovea, which represents the true contour of the retina.

To further demonstrate the stability and adaptability of this method, we also show the registration results on a scan that includes the optic nerve head, which is more complex than the fovea. The registration performance can be globally reviewed by volumetric rendering of the scan volumes before and after registration [Figs. 8(a)8(c)]. The registered volume shows the even and regular appearance of the optic nerve head and surrounding retina structures. The distorted cross-sectional B-frames on slow axis in the original volumes were corrected in the registered volume [Figs. 8(d)8(f)]. The image contrast of retinal layers and its microstructures are enhanced. Similar to the original fast axis B-frames, the registered and merged B-frame shows no translation artifacts [Figs. 8(g)8(i)]. En face OCTA after registration shows more continuous and distinctive vasculature than that in the nonregistered volume. Again, the retinal layer profiles and the regular anatomic microstructures of disc shown in the merged B-frame are highly correlated to the corresponding x-fast B-frame on the same position (Fig. 9).

Graphic Jump Location
Fig. 8
F8 :

3-D registration of two y-fast volumetric OCT and OCTA (6×10×7  mm) of disc region on a normal eye: (a) first volumetric OCT, (b) second volumetric OCT, (c) merged volumetric OCT after the 3-D registration of a and b, (d) the B-frame along x (slow)-axis in first volume (red line in j), (e) the B-frame along x-axis in second volume (red line in k), (f) the B-frame along x-axis in the merged volume (red line in l), (g) the B-frame along y (fast)-axis in first volume (yellow line in j), (h) the B-frame along y-axis in second volume (yellow line in k), (i) the B-frame along y-axis in the merged volume (yellow line in l), (j) first en face OCTA, (k) second en face OCTA, and (l) the merged en face OCTA after 3-D registration of two volumes.

Graphic Jump Location
Fig. 9
F9 :

(a) A comparison of the slow axis of the merged OCT and (b) the x-fast B-frame across the optic nerve head, which represents the true contour of the retina.

To quantitatively evaluate the registration accuracy, the average pixel distance (APD) between the ILM boundary of fast axis and the slow axis was calculated using the below equation: Display Formula

CAPD=1Lx=1L|Bfastaxis(x)Bslowaxis(x)|,(7)
where L is the number of the A-line in the overlap region between the fast axis and slow axis B-frames across foveal and disc regions, respectively. This overlap region was obtained after a rigid registration that includes translation and rotation only between a pair of fast axis and slow axis B-frames. This registration is also based on the affine registration using en face OCTA vascular information. To ensure the accuracy of this evaluation, only the B-frames across fovea and disc that have a distinctive structure feature were chosen in this assessment. The comparison to original retinal contours (ILM along fast axis) between registered and original slow axis B-frames is shown in Table 1.

Table Grahic Jump Location
Table 1The comparison of APD to fast axis B-frames on slow axis B-frames before and after registration.

To quantitatively measure the improvement of contrast on en face OCTA, the root-mean-square (RMS) contrast31 was used and calculated using the below equation: Display Formula

CRMS=1S×(x,y)S[V(x,y)V¯]2,(8)
where S is the area of the merged image, V(x,y) is the en face OCTA of the inner retinal slab, and V¯ is its mean decorrelation value.

These quantitative analyses demonstrate significant improvement of the retinal structural contour (Table 1) on the structural OCT and the RMS contrast (Table 2) on the en face OCTA.

Table Grahic Jump Location
Table 2The comparison of RMS contrast on en face OCTA before and after registration.

We have developed a 3-D registration method that removes motion artifacts and merges two volumetric angiographic and structural OCT volumes in the same transverse priority. This is well suited for OCTA using ultrahigh-speed OCT. The algorithm effectively eliminates axial and transverse motion artifacts, resulting in smooth volume rendering and high-contrast angiography with excellent vessel continuity.

The main interest of this study is the use of OCTA and structural OCT information separately for transverse and axial registration. To the best of our knowledge, no previous work has used a motion indicator on OCTA to guide volumetric registration. Compared to shadow-graphic pattern of large vessels on en face structural OCT, the detailed vasculature on OCT angiograms provides a better reference for transverse registration. Another advantage of using en face OCTA is that the microsaccade motions have been naturally shown as the bright motion artifact, eliminating the need to compute the cross-correlation between contiguous lines (projected B-frames) to detect this type of motion on en face structural OCT.

Unlike the previously reported orthogonal 3-D registration methods26 using full A-scan profiles, our method performs transverse and axial registration separately to achieve 3-D registration. This strategy allows a more efficient processing, especially on the large scan volume with large number of A-lines.

The transverse registration method in this study differs from our previous work25 in that we did not apply free-form deformation, which is a type of local nonrigid registration, because the translation of A-lines based on this deformation requires much computation time and memory space. Although the registration on the en face direction may not be as accurate as the work reported on 2-D OCTA,25 by adding the within-frame affine registration based on cross-sectional flow profile between each pair of y-fast B-frames, we were able to further improve the registration accuracy in 3-D.

To correct the motion in axial direction, we needed to rebuild the anatomic structure on the slow axis. Although we do not have a reference scan with different scan priority, we have demonstrated that the convergence of two B-frames on the slow axis from different OCT volumes can effectively recover a smooth retinal surface. However, the notable limitation of this method is that the registered retinal surface is still a few pixels different from the true retinal contour. This deficit may not be clinically significant because the recovered contour allows for accurate segmentation of retinal sublayers and generation of high-quality en face structural and angiographic images. Moreover, in this step, it is critical to accurately trace ILM boundaries. The large gradient of reflectance between the vitreous and the ILM usually allows accurate segmentation of this boundary. In our study, we applied the directional graph search method28 to further improve the segmentation efficacy.

Finally, this registration method is complementary to a real-time eye tracking function. Even with the acquisition of two volumetric scans, there is still a small probability of gaps occurring in the same place at both volumes, causing registration error and stripe defect in the merged volume. We have recently shown that we can reduce this failure probability to near zero by combining tracking assisted scanning with registration.18 Therefore, the registration algorithms developed by us and other groups would be useful in the correction of residual tracking error.

We propose an automated 3-D registration algorithm to remove motion artifacts and merging two volumetric OCT and OCTA scanned by an ultrahigh-speed swept-source OCT. We removed the motion artifacts in the “transverse” direction using the between-frame registration and corrected the “axial” location based on the ILM boundary of the retina. Two volumetric scans were merged after the axial registration and within-frame registration. We demonstrated our algorithm on OCT and OCTA volume including the macula and the disc in healthy volunteers. By improving the volume rendering of the retina and the quality of OCTA, this method may improve the utility of OCT-based ocular imaging.

Financial interests: OHSU, David Huang, and Yali Jia have a significant financial interest in Optovue. David Huang also has a financial interest in Carl Zeiss Meditec. These potential conflicts of interest have been reviewed and managed by OHSU.

This work was supported by National Institutes of Health under Grants Nos. DP3 DK104397, R01 EY024544, R01 EY023285, and P30 EY010572, the Oregon Health and Science University (OHSU) foundation, National Natural Science Foundation of China (Grant No. 61471226), the Natural Science Foundation for Distinguished Young Scholars of Shandong Province (Grant No. JQ201516), and an unrestricted grant from Research to Prevent Blindness.

Huang  D.  et al., “Optical coherence tomography,” Science. 254, (5035 ), 1178 –1181 (1991). 2156-7085 CrossRef 0036-8075 
Potsaid  B.  et al., “Ultrahigh speed spectral/Fourier domain OCT ophthalmic imaging at 70,000 to 312,500 axial scans per second,” Opt. Express. 16, , 15149 –15169 (2008). 1094-4087 CrossRef
Nankivil  D.  et al., “Coherence revival multiplexed buffered swept source optical coherence tomography: 400 kHz imaging with a 100 kHz source,” Opt. Lett.. 39, , 3740 –3743 (2014). 0146-9592 CrossRef
Jia  Y.  et al., “Split-spectrum amplitude-decorrelation angiography with optical coherence tomography,” Opt. Express. 20, (4 ), 4710 –4725 (2012). 1094-4087 CrossRef
Wang  R. K.  et al., “Three dimensional optical angiography,” Opt. Express. 15, (7 ), 4083 –4097 (2007). 1094-4087 CrossRef
Yousefi  S., , Zhi  Z., and Wang  R. K., “Eigen decomposition-based clutter filtering technique for optical micro-angiography,” IEEE Trans. Biomed. Eng.. 58, (8 ), 2316 –2323 (2011). 0018-9294 CrossRef
Makita  S.  et al., “Optical coherence angiography,” Opt. Express. 14, (17 ), 7821 –7840 (2006). 1094-4087 CrossRef
Mariampillai  A.  et al., “Speckle variance detection of microvasculature using swept-source optical coherence tomography,” Opt. Lett.. 33, (13 ), 1530 –1532 (2008). 0146-9592 CrossRef
Liu  G.  et al., “Intensity-based modified Doppler variance algorithm: application to phase instable and phase stable optical coherence tomography systems,” Opt. Express. 19, (12 ), 11429 –11440 (2011). 1094-4087 CrossRef
Kim  D. Y.  et al., “In vivo volumetric imaging of human retinal circulation with phase-variance optical coherence tomography,” Biomed. Opt. Express. 2, (6 ), 1504 –1513 (2011). 2156-7085 CrossRef
Yang  V. X. D.  et al., “Improved phase-resolved optical Doppler tomography using the Kasai velocity estimator and histogram segmentation,” Opt. Commun.. 208, (4–6 ), 209 –214 (2002). 0030-4018 CrossRef
Park  B. H.  et al., “Real-time multi-functional optical coherence tomography,” Opt. Express. 11, (7 ), 782 –793 (2003). 1094-4087 CrossRef
Nam  A. S., , Chico-Calero  I., and Vakoc  B. J., “Complex differential variance algorithm for optical coherence tomography angiography,” Biomed. Opt. Express. 5, (11 ), 3822 –3832 (2014). 2156-7085 CrossRef
Enfield  J., , Jonathan  E., and Leahy  M., “In vivo imaging of the microcirculation of the volar forearm using correlation mapping optical coherence tomography (cmOCT),” Biomed. Opt. Express. 2, (5 ), 1184 –1193 (2011). 2156-7085 CrossRef
Martinez-Conde  S., , Macknik  S. L., and Hubel  D. H., “The role of fixational eye movements in visual perception,” Nat. Rev. Neurosci.. 5, (3 ), 229 –240 (2004). 1471-003X CrossRef
Ratliff  F., and Riggs  L. A., “Involuntary motions of the eye during monocular fixation,” J. Exp. Psychol.. 40, , 687 –701 (1950). 0022-1015 CrossRef
Yun  S.  et al., “Motion artifacts in optical coherence tomography with frequency-domain ranging,” Opt. Express. 12, , 2977 –2998 (2004). 1094-4087 CrossRef
Camino  A.  et al., “Evaluation of artifact reduction in optical coherence tomography angiography with real-time tracking and motion correction technology,” Biomed. Opt. Express. 7, (10 ), 3905 –3915 (2016).CrossRef
Larocca  F.  et al., “Handheld simultaneous scanning laser ophthalmoscopy and optical coherence tomography system,” Biomed. Opt. Express. 4, , 2307 –2321 (2013). 2156-7085 CrossRef
Ferguson  R. D.  et al., “Tracking optical coherence tomography,” Opt. Lett.. 29, , 2139 –2141 (2004). 0146-9592 CrossRef
Braaf  B.  et al., “Real-time eye motion correction in phase-resolved OCT angiography with tracking SLO,” Biomed. Opt. Express. 4, (1 ), 51 –65 (2013). 2156-7085 CrossRef
Gorczynska  I.  et al., “En face projection imaging of the human choroidal layers with tracking SLO and swept source OCT angiography methods,” Proc. SPIE. 9541, , 954112  (2015). 0277-786X CrossRef
Zhang  Q.  et al., “Wide-field imaging of retinal vasculature using optical coherence tomography-based microangiography provided by motion tracking,” J. Biomed. Opt.. 20, (6 ), 066008  (2015). 1083-3668 CrossRef
Hendargo  H. C.  et al., “Automated non-rigid registration and mosaicing for robust imaging of distinct retinal capillary beds using speckle variance optical coherence tomography,” Biomed. Opt. Express. 4, (6 ), 803 –821 (2013). 2156-7085 CrossRef
Zang  P.  et al., “Automated motion correction using parallel-strip registration for wide-field en face OCT angiogram,” Biomed. Opt. Express. 7, (7 ), 2823 –2836 (2016). 2156-7085 CrossRef
Kraus  M. F.  et al., “Motion correction in optical coherence tomography volumes on a per A-scan basis using orthogonal scan patterns,” Biomed. Opt. Express. 3, (6 ), 1182 –1199 (2012). 2156-7085 CrossRef
Laser Institute of America, , American National Standard for the Safe Use of Lasers. ,  Laser Institute of America ,  Orlando, Florida  (2014).
Zhang  M.  et al., “Advanced image processing for optical coherence tomographic angiography of macular diseases,” Biomed. Opt. Express. 6, (12 ), 4661 –4675 (2015). 2156-7085 CrossRef
Estrada  R.  et al., “Enhanced video indirect ophthalmoscopy (VIO) via robust mosaicing,” Biomed. Opt. Express. 2, (10 ), 2871 –2887 (2011). 2156-7085 CrossRef
Frangi  A. F.  et al., “Multiscale vessel enhancement filtering,” in  Medical Image Computing and Computer Assisted Intervention (MICCAI) ,  Springer , pp. 130 –137 (1998).
Peli  E., “Contrast in complex images,” J. Opt. Soc. Am. A. 7, (10 ), 2032 –2040 (1990). 0740-3232 CrossRef

Pengxiao Zang is a master student of Shandong Normal University. He is also a research assistant at the Center for Ophthalmic Optics and Lasers Laboratory, Oregon Health and Science University (OHSU). His research interests include OCT, OCT angiography, and image processing.

Dengwang Li received his PhD from Shandong University through a joint PhD program with the University of Sydney sponsored by CSC. Currently, he is a professor in Shandong Normal University and is the vice director in the Shandong Province Key Laboratory of Medical Physics and Image Processing Technology. His research interests include medical image processing and its clinical applications.

Yali Jia received her PhD in biomedical engineering from OHSU, in 2010. She is an assistant professor of ophthalmology at OHSU. Her research interests include OCT and OCT angiography as well as their applications in retinal diseases.

© The Authors. Published by SPIE under a Creative Commons Attribution 3.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.

Citation

Pengxiao Zang ; Gangjun Liu ; Miao Zhang ; Jie Wang ; Thomas S. Hwang, et al.
"Automated three-dimensional registration and volume rebuilding for wide-field angiographic and structural optical coherence tomography", J. Biomed. Opt. 22(2), 026001 (Feb 01, 2017). ; http://dx.doi.org/10.1117/1.JBO.22.2.026001


Figures

Graphic Jump Location
Fig. 1
F1 :

The flow chart of the 3-D registration and volume rebuilding algorithm.

Graphic Jump Location
Fig. 2
F2 :

The schematic diagram of the between-frame registration process between two y-fast volumetric scans. (a) First en face OCTA. The white vertical line artifacts are caused by microsaccadic bulk motion. (b) Second en face OCTA. (c, d) The microsaccadic line artifacts are detected and removed, leaving intermicrosaccadic strips for registration. (e) The merged en face OCTA after affine registration of the strips.

Graphic Jump Location
Fig. 3
F3 :

The rebuilding process of the ILM boundary height profile along the x (slow)-axis. (a) The original reference (red) and moving (yellow) boundaries. (b) The transformed moving boundary (yellow) is translated to match the reference boundary (red) in average height. (c) The average height profile (green) of the reference (red) and transformed moving (yellow) boundary. (d) The average height profile is smoothed using a moving average filter to obtain the final ILM boundary (green).

Graphic Jump Location
Fig. 4
F4 :

The axial registration process. (a) The reference A-line of the normalized reflectance signal (red). (b) The moving A-line of the normalized reflectance signal (green). (c) The reference and moving A-line low-pass filtered by the Gaussian function. (d) The moving and reference A-line were registered by minimizing their sum squared difference and shifted to their mean position.

Graphic Jump Location
Fig. 5
F5 :

An example of the within-frame registration between a pair of OCTA B-frames. (a) The reference B-frame (flow signal in red). (b) The moving B-frame (green). (c) The moving B-frame is overlaid on the reference B-frame without registration. (d) The two B-frames after affine registration to minimize sum squared difference. The enlarged regions are outlined in blue. (e) Enlargement of panel c showing mismatch in the position of two large vessels (blue arrows). (f) Enlargement of panel d showing registration of the two mismatched vessels.

Graphic Jump Location
Fig. 6
F6 :

3-D registration of two y-fast volumetric OCT and OCTA (6×10×7  mm) of macular region on a normal eye: (a) first volumetric OCT, (b) second volumetric OCT, (c) merged volumetric OCT after the 3-D registration of a and b, (d) the B-frame along x (slow)-axis in first volume (red line in j), (e) the B-frame along x-axis in second volume (red line in k), (f) the B-frame along x-axis in the merged volume (red line in l), (g) the B-frame along y (fast)-axis in first volume (yellow line in j), (h) the B-frame along y-axis in second volume (yellow line in k), (i) the B-frame along y-axis in the merged volume (yellow line in l), (j) first en face OCTA, (k) second en face OCTA, and (l) the merged en face OCTA after 3-D registration of two volumes.

Graphic Jump Location
Fig. 7
F7 :

(a) A comparison of the slow axis B-frame of the merged OCT and (b) the x-fast B-frame crossing the fovea, which represents the true contour of the retina.

Graphic Jump Location
Fig. 8
F8 :

3-D registration of two y-fast volumetric OCT and OCTA (6×10×7  mm) of disc region on a normal eye: (a) first volumetric OCT, (b) second volumetric OCT, (c) merged volumetric OCT after the 3-D registration of a and b, (d) the B-frame along x (slow)-axis in first volume (red line in j), (e) the B-frame along x-axis in second volume (red line in k), (f) the B-frame along x-axis in the merged volume (red line in l), (g) the B-frame along y (fast)-axis in first volume (yellow line in j), (h) the B-frame along y-axis in second volume (yellow line in k), (i) the B-frame along y-axis in the merged volume (yellow line in l), (j) first en face OCTA, (k) second en face OCTA, and (l) the merged en face OCTA after 3-D registration of two volumes.

Graphic Jump Location
Fig. 9
F9 :

(a) A comparison of the slow axis of the merged OCT and (b) the x-fast B-frame across the optic nerve head, which represents the true contour of the retina.

Tables

Table Grahic Jump Location
Table 1The comparison of APD to fast axis B-frames on slow axis B-frames before and after registration.
Table Grahic Jump Location
Table 2The comparison of RMS contrast on en face OCTA before and after registration.

References

Huang  D.  et al., “Optical coherence tomography,” Science. 254, (5035 ), 1178 –1181 (1991). 2156-7085 CrossRef 0036-8075 
Potsaid  B.  et al., “Ultrahigh speed spectral/Fourier domain OCT ophthalmic imaging at 70,000 to 312,500 axial scans per second,” Opt. Express. 16, , 15149 –15169 (2008). 1094-4087 CrossRef
Nankivil  D.  et al., “Coherence revival multiplexed buffered swept source optical coherence tomography: 400 kHz imaging with a 100 kHz source,” Opt. Lett.. 39, , 3740 –3743 (2014). 0146-9592 CrossRef
Jia  Y.  et al., “Split-spectrum amplitude-decorrelation angiography with optical coherence tomography,” Opt. Express. 20, (4 ), 4710 –4725 (2012). 1094-4087 CrossRef
Wang  R. K.  et al., “Three dimensional optical angiography,” Opt. Express. 15, (7 ), 4083 –4097 (2007). 1094-4087 CrossRef
Yousefi  S., , Zhi  Z., and Wang  R. K., “Eigen decomposition-based clutter filtering technique for optical micro-angiography,” IEEE Trans. Biomed. Eng.. 58, (8 ), 2316 –2323 (2011). 0018-9294 CrossRef
Makita  S.  et al., “Optical coherence angiography,” Opt. Express. 14, (17 ), 7821 –7840 (2006). 1094-4087 CrossRef
Mariampillai  A.  et al., “Speckle variance detection of microvasculature using swept-source optical coherence tomography,” Opt. Lett.. 33, (13 ), 1530 –1532 (2008). 0146-9592 CrossRef
Liu  G.  et al., “Intensity-based modified Doppler variance algorithm: application to phase instable and phase stable optical coherence tomography systems,” Opt. Express. 19, (12 ), 11429 –11440 (2011). 1094-4087 CrossRef
Kim  D. Y.  et al., “In vivo volumetric imaging of human retinal circulation with phase-variance optical coherence tomography,” Biomed. Opt. Express. 2, (6 ), 1504 –1513 (2011). 2156-7085 CrossRef
Yang  V. X. D.  et al., “Improved phase-resolved optical Doppler tomography using the Kasai velocity estimator and histogram segmentation,” Opt. Commun.. 208, (4–6 ), 209 –214 (2002). 0030-4018 CrossRef
Park  B. H.  et al., “Real-time multi-functional optical coherence tomography,” Opt. Express. 11, (7 ), 782 –793 (2003). 1094-4087 CrossRef
Nam  A. S., , Chico-Calero  I., and Vakoc  B. J., “Complex differential variance algorithm for optical coherence tomography angiography,” Biomed. Opt. Express. 5, (11 ), 3822 –3832 (2014). 2156-7085 CrossRef
Enfield  J., , Jonathan  E., and Leahy  M., “In vivo imaging of the microcirculation of the volar forearm using correlation mapping optical coherence tomography (cmOCT),” Biomed. Opt. Express. 2, (5 ), 1184 –1193 (2011). 2156-7085 CrossRef
Martinez-Conde  S., , Macknik  S. L., and Hubel  D. H., “The role of fixational eye movements in visual perception,” Nat. Rev. Neurosci.. 5, (3 ), 229 –240 (2004). 1471-003X CrossRef
Ratliff  F., and Riggs  L. A., “Involuntary motions of the eye during monocular fixation,” J. Exp. Psychol.. 40, , 687 –701 (1950). 0022-1015 CrossRef
Yun  S.  et al., “Motion artifacts in optical coherence tomography with frequency-domain ranging,” Opt. Express. 12, , 2977 –2998 (2004). 1094-4087 CrossRef
Camino  A.  et al., “Evaluation of artifact reduction in optical coherence tomography angiography with real-time tracking and motion correction technology,” Biomed. Opt. Express. 7, (10 ), 3905 –3915 (2016).CrossRef
Larocca  F.  et al., “Handheld simultaneous scanning laser ophthalmoscopy and optical coherence tomography system,” Biomed. Opt. Express. 4, , 2307 –2321 (2013). 2156-7085 CrossRef
Ferguson  R. D.  et al., “Tracking optical coherence tomography,” Opt. Lett.. 29, , 2139 –2141 (2004). 0146-9592 CrossRef
Braaf  B.  et al., “Real-time eye motion correction in phase-resolved OCT angiography with tracking SLO,” Biomed. Opt. Express. 4, (1 ), 51 –65 (2013). 2156-7085 CrossRef
Gorczynska  I.  et al., “En face projection imaging of the human choroidal layers with tracking SLO and swept source OCT angiography methods,” Proc. SPIE. 9541, , 954112  (2015). 0277-786X CrossRef
Zhang  Q.  et al., “Wide-field imaging of retinal vasculature using optical coherence tomography-based microangiography provided by motion tracking,” J. Biomed. Opt.. 20, (6 ), 066008  (2015). 1083-3668 CrossRef
Hendargo  H. C.  et al., “Automated non-rigid registration and mosaicing for robust imaging of distinct retinal capillary beds using speckle variance optical coherence tomography,” Biomed. Opt. Express. 4, (6 ), 803 –821 (2013). 2156-7085 CrossRef
Zang  P.  et al., “Automated motion correction using parallel-strip registration for wide-field en face OCT angiogram,” Biomed. Opt. Express. 7, (7 ), 2823 –2836 (2016). 2156-7085 CrossRef
Kraus  M. F.  et al., “Motion correction in optical coherence tomography volumes on a per A-scan basis using orthogonal scan patterns,” Biomed. Opt. Express. 3, (6 ), 1182 –1199 (2012). 2156-7085 CrossRef
Laser Institute of America, , American National Standard for the Safe Use of Lasers. ,  Laser Institute of America ,  Orlando, Florida  (2014).
Zhang  M.  et al., “Advanced image processing for optical coherence tomographic angiography of macular diseases,” Biomed. Opt. Express. 6, (12 ), 4661 –4675 (2015). 2156-7085 CrossRef
Estrada  R.  et al., “Enhanced video indirect ophthalmoscopy (VIO) via robust mosaicing,” Biomed. Opt. Express. 2, (10 ), 2871 –2887 (2011). 2156-7085 CrossRef
Frangi  A. F.  et al., “Multiscale vessel enhancement filtering,” in  Medical Image Computing and Computer Assisted Intervention (MICCAI) ,  Springer , pp. 130 –137 (1998).
Peli  E., “Contrast in complex images,” J. Opt. Soc. Am. A. 7, (10 ), 2032 –2040 (1990). 0740-3232 CrossRef

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

PubMed Articles
Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.