Research Papers: Imaging

Reduction of shading-derived artifacts in skin chromophore imaging without measurements or assumptions about the shape of the subject

[+] Author Affiliations
Kenichiro Yoshida, Nobutoshi Ojima, Kayoko Iwata

Kao Corporation, Beauty Research Center, 2-1-3 Bunka, Sumida-ku, Tokyo 131-8501, Japan

Izumi Nishidate

Tokyo University of Agriculture & Technology, Graduate School of Bio-applications & Systems Engineering, 2-24-16 Naka-cho, Koganei, Tokyo 184-8588, Japan

J. Biomed. Opt. 19(1), 016009 (Jan 09, 2014). doi:10.1117/1.JBO.19.1.016009
History: Received August 21, 2013; Revised December 8, 2013; Accepted December 9, 2013
Text Size: A A A

Open Access Open Access

Abstract.  To quantitatively evaluate skin chromophores over a wide region of curved skin surface, we propose an approach that suppresses the effect of the shading-derived error in the reflectance on the estimation of chromophore concentrations, without sacrificing the accuracy of that estimation. In our method, we use multiple regression analysis, assuming the absorbance spectrum as the response variable and the extinction coefficients of melanin, oxygenated hemoglobin, and deoxygenated hemoglobin as the predictor variables. The concentrations of melanin and total hemoglobin are determined from the multiple regression coefficients using compensation formulae (CF) based on the diffuse reflectance spectra derived from a Monte Carlo simulation. To suppress the shading-derived error, we investigated three different combinations of multiple regression coefficients for the CF. In vivo measurements with the forearm skin demonstrated that the proposed approach can reduce the estimation errors that are due to shading-derived errors in the reflectance. With the best combination of multiple regression coefficients, we estimated that the ratio of the error to the chromophore concentrations is about 10%. The proposed method does not require any measurements or assumptions about the shape of the subjects; this is an advantage over other studies related to the reduction of shading-derived errors.

Figures in this Article

The concentrations of chromophores in skin provide important information for making a diagnosis, and images can provide additional information, such as the size of a lesion, that aid visual understanding. Therefore, many studies have been conducted to evaluate the concentration of chromophores,16 and some of these studies discuss imaging, in which visible light spectroscopy is usually used to achieve high spatial resolution.713 Multiple regression analysis (MRA) based on the Beer–Lambert (B–L)3 law is a simple way to correlate the chromophore concentrations with the reflectance of skin. The B–L law has been applied to the three-layer skin model of epidermis, dermis, and fat, with the assumptions that no scattering occurs in the epidermis or dermis and no wavelength dependency exists in the reflectance from the fat layer.3 With these assumptions, the optical path length becomes constant and does not depend on wavelength. Therefore, in accordance with the B–L law, the absorbance (the logarithm of the inverse of the reflectance) can be expressed as a linear combination of the absorption coefficient spectrums of melanin, oxygenated hemoglobin, and deoxygenated hemoglobin, and a constant term. The constant term comes from the reflectance of the fat layer. The regression analysis uses the absorbance spectrum as a response variable and the extinction coefficient of each of the chromophores as the predictor variables. Although the implementation is easy, the model is quite different from actual conditions, and it leads to inconsistencies between the actual and the fitted spectrums.4,14,15

To improve the estimation, the modified B–L method has been introduced.4,5 Although the method is based on the B–L law, the optical path length is allowed to be wavelength dependent. This added degree of freedom allows a part of the scattering effect to be included, and it improves the coefficient of determination.4,5 In this method, as the predictor variables in the MRA, the product of each absorption coefficient and the wavelength-dependent path length was used. However, the method assumes that the optical path length is independent of the concentrations of chromophores, and thus the results are still different from measurements of the actual phenomenon. Neither the nonlinearity between the concentration and the absorbance nor the cross-talk between the chromophores has been taken into account.1,14,15

In order to fully account for the effect of scattering in the estimation of chromophore concentrations, several methods have been considered; these include methods based on random work theory,12 Kubelka–Munk theory,8 a support vector machine,11 and an empirical method aided by a Monte Carlo simulation (MCS).1,9 Although scattering effects are fully considered in these methods, the methods are susceptible to shading-derived errors caused by the incomplete estimation of the irradiance.8,11,12 This is a serious problem for visual understanding and quantitative evaluation of the chromophore imaging. Here, “shading” is the spatial distribution of irradiance. Shading results from the incident angle of the light, the spectral radiant intensity of the light source, and the distance from the light source. If the actual irradiance on the surface of a subject is lower than the estimate, then the apparent reflectance decreases and the chromophore concentrations will be overestimated; this tends to occur on the fringe areas of the subject. Therefore, for a precise calibration of reflectance, besides the radiant intensity distribution of the light, the shape of the subject also must be assessed (unless the areas of interest are limited to small, flat areas in which the irradiance can be fully assessed).1 The problem with shading is common among methods that consider nonlinear scattering effects in imaging.10

Several studies have attempted to correct for the shading effect. In these studies, the shape of each subject was measured13,16 or the curvature effect was otherwise extracted12 and taken into account. However, these approaches require hardware modifications and additional measurements or else assumptions about the shapes of the samples.

Incidentally, in the simple and modified B–L methods, in which the absorbance is expressed as a linear combination of each chromophore component with a constant term, the shading-derived error is not observed in the images of chromophore concentrations. The effect of surface curvature is proportional to irradiance, and in the absorbance, it is a constant term, independent of wavelength. Therefore, the effect of surface curvature will appear only in the constant term and will not appear in the image of the chromophore concentrations.

In order to fully account for the scattering effect and to reduce the shading-derived artifact, we propose an approach based on the MCS-aided empirical method.1,9 In this method, the simple B–L method is used to derive multiple regression coefficients related to the concentrations of melanin, oxygenated hemoglobin, and deoxygenated hemoglobin. Then, the multiple regression coefficients are converted to the concentrations of melanin and total hemoglobin (sum of oxygenated and deoxygenated hemoglobin) using compensation formulae (CF), which are derived from the diffuse reflectance spectra of human skin, numerically calculated in advance by a MCS.17 In the previous method,1,9 the constant term of the multiple regression coefficients, as well as the regression coefficients of melanin and total hemoglobin, were used in the CFs. Although the use of the constant term is important for estimating the absolute values of chromophore concentrations, it can cause the shading-derived error in reflectance that results in an overestimation of the chromophore concentrations. Since the shading-derived error is concentrated into the constant term during the first step of the MRA, selecting the optimal combination of multiple regression coefficients has the potential to satisfy both of the requirements. In vivo experiments with a human forearm were performed to confirm the usefulness of the proposed approach for improving the robustness of the method against the estimation error in the irradiance.

Outline of the Method

According to the B–L law, the absorbance spectrum A(λ), which is derived from the reflectance spectrum R(λ) as A(λ)=log(1/R(λ)), can be approximated with the following formula:1,9Display Formula

A(λ)=am·εm(λ)+aoh·εoh(λ)+adh·εdh(λ)+a0.(1)
Here, melanin, oxygenated hemoglobin, and deoxygenated hemoglobin are assumed to be the main contributors to the absorption of light in skin. In Eq. (1), λ represents the wavelength; εm, εoh, and εdh are the spectral absorption coefficients of melanin, oxygenated hemoglobin, and deoxygenated hemoglobin, respectively; am, aoh, and adh are the respective concentration-related values; and a0 is the constant term. Equation (1) can be calculated by a multiple regression analysis (MRA1), in which A represents the response variables, and εm, εoh, and εdh are the predictor variables. Then, am, aoh, adh, and a0 are derived as the multiple regression coefficients.

Our proposed method obtains prior estimates of the relationship between the MRA1 regression coefficients and the chromophore concentrations of the MCS. With the MCS, a spectrum can be calculated from a given set of chromophore concentrations according to the skin model described in Sec. 2.2. Then, a set of regression coefficients can be derived from the spectrum using MRA1. By calculating regression coefficients for several sets of concentrations, sets of regression coefficients can be associated with particular chromophore concentrations. Polynomial, exponential, or logarithmic functions, or a combination of these functions, can be used as the form of the CFs. In this study, we used a polynomial form because it can be solved analytically by MRA. To derive the CFs for calculating the concentrations from the regression coefficients, another multiple regression analysis (MRA2) was used. Here, we considered the original concentrations from the MCS to be the response variables and their products with the regression coefficients from MRA1 to be the predictor variables; we will call this MRA2. In symbolic form, MRA2 is expressed as Display Formula

ci=bi·a,(2)
where i represents m (for melanin) or th (for hemoglobin). Here, ci is the estimated concentration of the respective chromophore, a is a vector whose elements are the regression coefficients from MRA1 and their higher-order terms, and bi is the vector converting the regression coefficients to concentrations.

Correlating the Multiple Regression Coefficient with the Chromophore Concentrations

We used the same skin model and the same parameters that were used in the previous studies1,9 as follows: a two-layered model of the epidermis with uniform melanin and an underlying dermis with uniform oxygenated and deoxygenated hemoglobin was used; the thicknesses of the epidermis and dermis were 0.06 and 4.94 mm, respectively. The refractive indices n were assumed to be 1.4, independent of wavelength and layer. The refractive index of the external area was set to 1. The absorption coefficients of the epidermis and dermis were assumed to be εm(λ)Cm and εoh(λ)Coh+εdh(λ)Cdh, respectively. Here, Cm, Coh, and Cdh are the concentrations of melanin, oxygenated hemoglobin, and deoxygenated hemoglobin in each layer. For εm(λ), we used the average absorption coefficient of a monomer melanosome with a concentration of 1mol/l; this was approximated as 6.6×1011×λ3.33, where the unit of λ is nanometers.18 For εoh and εdh, we used the extinction coefficients of oxygenated and deoxygenated hemoglobin, respectively, converted to the concentration of 45 hematocrit in blood.19 The scales of Cm, Coh, and Cdh were the ratios of the concentrations to those under which εm(λ), εoh(λ), and εdh(λ), respectively, were derived. To characterize the scattering, a reduced scattering coefficient μs(λ) is required; this is derived from μs(λ)=μs(λ)×(1g), using the scattering coefficient μs(λ) and anisotropy g, which are the primitive parameters of scattering.20,21 The value of μs(λ) for both the epidermis and dermis was 2×105×λ1.5+2×1012×λ4; the first term represents Mie scattering, the second one represents Rayleigh scattering,2022 and the unit of λ is nanometers.

The MCS (using the program MCML17) was used to derive the spectra for various concentrations of chromophores; am, aoh, adh, and a0 were then calculated using MRA1. The calculated melanin concentrations Cm were set from 1% to 10% in 1% intervals, the hemoglobin concentration Cth (=Coh+Cdh) was set from 0.2% to 1% in 0.2% intervals, and the oxygen saturation CStO2 (=Coh/Cth) was set from 0% to 100% in 20% intervals. The wavelength was set from 500 to 600 nm in 20-nm intervals, and the number of photons under a single condition was 105.23 From the MCS calculations under the various conditions, a total of 300 spectra were generated. In the MCS, the incident angle was set to 0 deg and, for statistical accuracy, the reflectance was integrated over the entire reflected angle. Although the outgoing angle was not the same as in the actual measurement condition (see Sec. 2.6), it is appropriate if Lambertian reflection is assumed; it gives a first-order approximation of internal reflection.24 For each combination of (Cm, Coh, Cdh), after the reflectance spectra were converted to absorbance spectra, am, aoh, adh, and a0 were calculated using MRA1.

Shading Effect

Shading has an effect on the results of MRA1, and thus consequently, on the estimated chromophore concentrations. Assuming Lambertian reflection and using θi to denote the angle between the surface and the incoming light, the irradiance is cosθi times that of normal incidence, independent of wavelength. Therefore, the apparent reflectance can be expressed as R=R×cosθi, where the actual reflectance is defined as R. Also, the apparent absorbance A can be expressed as A=log(1/R)=A+log(1/cosθi), where the actual absorbance is A=log(1/R). Since the second term is independent of the wavelength, a0 becomes log(1/cosθi) larger than it is in the case of normal incidence.10

We assumed that a light, a camera, and a cylindrical subject of radius r are arranged as follows. The cylinder is placed so that the center is at the origin and the axis of symmetry lies along the x-axis, the camera lies on the z-axis, and the light source is in the zx-plane (Fig. 1). The light vector S can be expressed as (sinθS,0,cosθS) at any point on the subject. Similarly, the normal vector N at the point (x0,y0) is (0,y0/r,1y02/r2). Therefore, the incident angle (the angle between S and N) is cos1(cosθS·1y02/r2). Under this arrangement, the incident angle depends on the y-coordinate and increases with increasing distance from the x-axis, so a0 also increases. The intensity of the reflected light is expected to depend less on the viewing angle θo than on the incident angle, because, in the case of Lambertian reflection,24 the observation point does not affect the intensity of the reflected light.

Graphic Jump LocationF1 :

Notation of positional and angular relationships for a point on a cylindrical subject in relation to a light source and a camera. Each symbol represents S: light vector, N: normal vector, V: viewing vector, θi: incident angle, θo: viewing angle, θS: angle between S and V, r: radius of the cylindrical subject, (x0,y0): coordinate value of a point on the subject.

Formula of the Relationship Between the Multiple Regression Coefficients and the Chromophore Concentrations

From the description in Sec. 2.3, for MRA1, we assumed that the shading effect would appear mainly in the a0. Therefore, when using the regression coefficients of MRA1 to estimate the chromophore concentrations, removing a0 from the CFs will eliminate the shading effect.

Note that the form of the polynomial equation is the key factor of our method. Removing a0 from the CFs will reduce the estimated errors in the chromophore concentrations that are due to shading-derived errors in the reflectance. However, this will decrease the accuracy of the CFs, because a0 also includes information related to the concentration of each chromophore. To compensate for the absence of a0, we separate ath into aoh and adh. To determine the appropriate CFs, we considered using the following three types of a in Eq. (2) and examined each with various choices for the regression coefficients. Display Formula

aCF1=(1amatha0am2ath2a02am·athath·a0a0·am)T(3)
Display Formula
aCF2=(1amatham2ath2am·atham3ath3am·ath2am2·ath)T(4)
Display Formula
aCF3=(1amaohadham2aoh2adh2am·aohaoh·adhadh·am)T(5)
Here, ath is defined as the sum of aoh and adh, and T represents the transpose. In Eq. (3), am, ath, and a0 were used in the CFs, and the choice of the regression coefficient was the same as in previous studies.1,9 In Eq. (4), am and ath were used in the CFs, but a0 was not used. In Eq. (5), aoh and adh were used instead of ath. To adjust the degrees of freedom between CF1, CF2, and CF3, the maximum degree of CF2 was set to three, and those of CF1 and CF3 were set to two. In CF2 and CF3, in which a0 was omitted, the artifact from shading was expected to be removed due to the manifestation of the shading effect in the coefficient a0 (see Sec. 2.3). In any of these CFs, the oxygen saturation aStO2 can be calculated as aoh/ath.

Experiments
Correlation between estimated and expected value of chromophore concentrations

The chromophore concentrations were estimated with each CF from the spectrum made by the MCS and compared with the inputs of the MCS, which were the expected values. For this calculation, the skin model described in Sec. 2.2 (the same skin model parameters used for MRA2) was used.

Measurement of forearm skin

The right forearms of Japanese males (N=5) in their 20s to 40 s were measured with the measuring device described in Sec. 2.6. For each subject, the forearm was placed horizontally and images were captured. This was done for two different postures: the inner forearm facing front (angle 1) and facing 45deg upward (angle 2). To correlate the positions on the forearm, several points were marked in a reticular pattern at a distance of 2 cm from neighboring points. After performing MRA1, the chromophore concentrations were calculated as images by using the CFs.

The averaged values of the chromophore concentrations in a 10×10pixel (2.5×2.5mm2 when the surface faces front) area at the middle of horizontally neighboring marks were calculated for each CF.

Measuring Device

The following apparatus was prepared (Fig. 2). A camera (CV-M7+CL; jAi, Yokohama, Japan) was set in front of the subject. A liquid-crystal wavelength-tunable filter (VariSpec; CRi, Hopkinton, Massachusetts; full width at half maximum: 10 nm) and a polarizer were set in front of the camera. Two halogen lights were set at the left and right sides of the camera in such a way that the angle between the camera and the lights was 30 deg. An infrared cut filter and a polarizer, which was set to be orthogonal to the polarizer in front of the camera, were set between each light source and the subject; this was done to reduce the specular reflection from the skin surface.10

Graphic Jump LocationF2 :

Schematic of the measuring system.

Images were captured using a personal computer and by varying the transparent wavelength of the VariSpec. The resolution of the camera was 4pixel/mm on a subject facing frontwards, and the pixel depth was 10 bits. The transparent wavelength was set from 500 to 600 nm, with an interval of 20 nm. The measurement time was about 10 s in total. Although we used a color camera, we used only the green channel. For calibration, we captured images of a gray card besides images of subjects, and the pixel values were converted to reflectance in a pixel-by-pixel manner. In the calibration, the pixel value of the white chart was also used, and it was set below the subject. The reflectance can be derived from this calibration if the surface of interest is perpendicular to the line of sight. However, if the surface of interest is not perpendicular to the line of sight, the shading-derived error in the reflectance, i.e., the calibration error in the reflectance, will be increased according to cosθi, as shown in Fig. 1.

Statistics
Correlation between estimated and expected value of chromophore concentrations

In the statistical analysis of the estimated and expected values of chromophore concentrations from the MCS, the standard deviation, σ, of each condition was defined as Display Formula

σi2=j=1n(ci,jCi,j)2/(n1).(6)
Here, i is m (melanin) or th (hemoglobin), n is the number of data points, j indicates a particular data point, and ci,j and Ci,j are, respectively, the estimated and expected values.

Measurement of forearm skin

In the statistical analysis of forearm skin, the variance V was determined as Display Formula

Vi,j=(ciof angle1atjtharea)(ciof angle2atjtharea).(7)
Here, i is m (melanin) or th (hemoglobin) and ci is the measured chromophore concentration. Assuming that the dispersion of the difference between ci and the real value is equal to half of the dispersion of V, the standard deviation σi of the difference between the real and measured values of ci can be derived from the following equation: Display Formula
σi2=(j=1nVi,j2/(n1))/2,(8)
where n is the number of measured areas.

Correlation between Estimated and Expected Value of Chromophore Concentrations

For CF1, CF2, and CF3, the relationships between the original Ci and the estimated ci (i=m, th) are shown in Fig. 3. The σ were 0.025, 0.481, and 0.084 for the melanin concentration estimated with CF1, CF2, and CF3, respectively, and 0.008, 0.092, and 0.016 for the hemoglobin concentration measured with CF1, CF2, and CF3, respectively. The errors increased in the order of CF1, CF3, and CF2.

Graphic Jump LocationF3 :

Correlations between the original and the estimated values of (a) melanin and (b) hemoglobin, using CF1; (c) melanin and (d) hemoglobin, using CF2; and (e) melanin and (f) hemoglobin, using CF3. Horizontal axis: original values; vertical axis: estimated values. The unit of the horizontal and vertical axes is %.

Measurement of Forearm Skin

Images of the inner forearm from sets of spectra images are shown in Fig. 4, and Fig. 5 shows the images of the regression coefficients of the framed area in Fig. 4(a). Although the systematic variation from the center to the fringe (upper and lower sides in the pictures) cannot be found in am [Fig. 5(a)] or ath [Fig. 5(b)], the value of a0 became greater at the fringe [Fig. 5(e)]. In aoh [Fig. 5(c)] and adh [Fig. 5(d)], the values became slightly larger and smaller at the edges, respectively, but the degree to which this happens is smaller than it was for a0. The value of aStO2 was affected by the trend of aoh and adh and decreased slightly at the fringe [Fig. 5(c)]. The average and standard deviation of each regression coefficient of the sites A, B, C, and D in Fig. 4(a) were calculated, and the values were as follows: am=(2.1±0.2)×104; ath=(1.6±0.1)×106; aoh=(8.5±0.9)×107; adh=(7.6±1.1)×107; a0=(2.2±0.2)×101; and aStO2=(55±5)%.

Graphic Jump LocationF4 :

Representative example of measured images (appearance) from different angles. The inner side of the forearm faced (a) straight or (b) upward. The hand is to the left side. To correlate the positions, points were marked in a reticular pattern. The symbols drawn on the pictures are the measured points for Fig. 8. The framed area in (a) is the area shown in Figs. 5 and 6.

Graphic Jump LocationF5 :

Representative example of images of the multiple regression coefficients: (a) am; (b) ath (=aoh+adh); (c) aoh; (d) adh; (e) a0; and (f) aStO2 (=aoh/ath). The area of the images is the area surrounded by a border in Fig. 4(a). The background is masked in black. The value of each regression coefficient corresponds to the brightness. The lower limit is zero for all images, and the upper limit (“Max”) is 5×104 for am, 4×106 for ath, 1×106 for aoh, 1×106 for adh, 1 for a0, and 100% for aStO2. The reticular pattern is made up of points marked on the skin, and it can be clearly seen in (e).

Next, the chromophore concentrations were estimated with each CF. Figure 6 presents the images of a representative example of these. In CF1, the values of cm and cth increased from the center to the fringe, but in CF3, no such tendency could be observed. This tendency is also seen in Fig. 7. From the cross-section, the values of CF3 near the center were close to those of CF1 [Figs. 7(a) and 7(b)]. On the other hand, the fluctuations of CF3 are larger than those of CF1. In CF2 also, a systematic variation could not be found, but the fluctuations were larger than those of CF3. The differences between these and the values with CF1 were especially observable in cth [Fig. 7(b)]. The averages and standard deviations of the magnified area in Fig. 7 were 5.7±0.6%, 4.7±1.5%, and 5.1±1.2% for melanin with CF1, CF2, and CF3, respectively, and 0.19±0.05%, 0.10±0.08%, and 0.18±0.05% for hemoglobin with CF1, CF2, and CF3, respectively.

Graphic Jump LocationF6 :

Estimated cm and cth with each CF. (a)–(b) with CF1: (a) cm and (b) cth; (c)–(d) with CF2: (c) cm and (d) cth; (e)–(f) with CF3: (e) cm and (f) cth. The value of each estimated concentration corresponds to the brightness; the lower limit is zero for all images, and the upper limit (“Max”) is 10% and 0.25% for the images of cm and cth, respectively. The dotted line and the characters “X” and “Y” in (a) represent the cross-section and ends represented in Fig. 7. The background is masked in black. The reticular pattern is made up of points marked on the skin.

Graphic Jump LocationF7 :

Cross-sections of the estimated (a) cm and (b) cth, with CF1, CF2, and CF3. CF1: gray broken lines, CF2: dotted lines, CF3: solid black lines. The plots shown above are the magnified figures of the framed areas. The cross-sections were taken along the dotted lines in Fig. 6(a), and the sides X and Y correspond to the positions noted in Fig. 6(a). The unit of the vertical axes is %.

Finally, cm and cth estimated from different angles at the same site were compared, and the results from a representative example are shown in Fig. 8. The differences between the values of different angles at each position with CF3 were smaller than those with CF1. The values of σ for the representative example for melanin and hemoglobin (Fig. 8) were, respectively, 1.8% and 0.15% for CF1, 0.3% and 0.02% for CF2, and 0.3% and 0.01% for CF3. The values of σ for melanin and hemoglobin for all sites and all subjects were, respectively, 1.3% and 0.15% for CF1, 0.4% and 0.02% for CF2, and 0.3% and 0.02% for CF3. Figure 9 shows a plot of cm and cth for all subjects and all points for CF3.

Graphic Jump LocationF8 :

Correlation between the estimates from different angles (angles 1 and 2) of the melanin and the hemoglobin concentrations at each position of the representative example (same subject as in Fig. 4). (a)–(b): cm calculated with (a) CF1 and (b) CF3; (c)–(d): cth calculated with (c) CF1 and (d) CF3. The symbols and legend (A to D) are the same as those used in Fig. 4. The unit of the horizontal and vertical axes is %.

Graphic Jump LocationF9 :

Correlation between the estimates from different angles (angles 1 and 2) of the melanin and the hemoglobin concentrations at each position for all subjects. (a): cm; (b): cth calculated with CF3. The diagonal solid line represents y=x, and the diagonal gray broken line represents y=x±1.96σ, which is the 95% confidence interval assuming the V follows a Gaussian distribution. The unit of the horizontal and vertical axes is %.

Under the condition that the forearm was set horizontally and the lights were set at the left and right sides of the camera, the incident angle at the upper and lower sides were greater than that at the center. Therefore, the irradiance at the surface became smaller. As we expected (see Sec. 2.3), the shading effect appeared in the a0 image [Fig. 5(e)], and became greater at the fringe. As a consequence, with CF1 [Figs. 6(a) and 6(b)], since the formula contains a0 [Fig. 5(e)], the effect of the shading can be seen in the estimation of chromophore concentrations. This tendency seems to be larger for hemoglobin than for melanin. With CF3 [Figs. 6(e) and 6(f)], which does not contain a0, the artifact is hardly seen, as expected. The improvement is shown more clearly in Fig. 8. Each position on the subject should have the same chromophore concentrations even if the measurement angle is changed. Thus the points plotted in Fig. 8 should be on the line x=y. Obviously, the points plotted for CF3 were closer to x=y than those for CF1, which were quantified with σ. From these results, we conclude that the estimation errors in the chromophore concentrations that are due to the shading-derived error in the reflectance, were greatly reduced by the proposed approach. With CF3, the σ were 0.3% and 0.02% for cm and cth, and the ranges of cm and cth were 3% to 6% and 0.15 to 0.25%, respectively (Fig. 9), which demonstrates that the ratio of the error to the chromophore concentrations is about 10%.

Near the center, where irradiance was evaluated correctly, CF3 estimated the same values, on average, as did CF1 (Fig. 7). In other words, CF3 is as accurate as CF1 when there is less of an effect of shading. Furthermore, the values are within the expected ranges of concentration: cm, cth, and aStO2 for the representative example were 5.0±0.7%, 0.17±0.01%, and 55±5%, respectively, which agrees with the average values for Japanese subjects as reported in the literature.1,22

In the case of CF2 [Figs. 6(c) and 6(d)], although the shading effect was suppressed, the fluctuation was large. Moreover, the average value is very different from the value with CF1 near the center (Fig. 7). This tendency was notable for cth. This probably came from the error between the expected and estimated chromophore concentrations, which can be seen in Figs. 3(c) and 3(d).

Although in Sec. 2.2, we assumed Lambertian reflection for the angular dependency of reflection from skin as a precondition of the constancy of reflectance with varying outgoing angles, this precondition can be loosened. Lambertian reflection proved to be an inaccurate approximation for several real-world objects.24 However, in the proposed method, to the extent that the angular dependency of the reflected light is proportional between wavelengths, the chromophore concentrations will not be affected by the viewing angle. This is because the multiplication of the reflectance by an independent factor of the wavelength will be included in a0 in the same way that the shading effect is included in a0. From the fact that the variation from the center to the fringe does not explicitly appear in the multiple regression coefficients other than a0 (Fig. 5), we infer that the loosened precondition is almost true when the viewing angle increases from the center to the fringe, as does the incident angle. Nonetheless, the penetration depth seems dependent in some way besides the shading effect on the incident angle and viewing angles. At the very edge of the forearm, aoh and adh became slightly smaller and larger, respectively [Figs. 5(c) and (d)], which can be explained by a shallower penetration depth with a larger incident angle. The oxygen saturation in a shallower region is expected to be lower than that in a deeper region,25 which is the trend seen in the derived images.

There are some side effects from removing a0 from the CFs, and these should be improved. First, although the fluctuations with CF3 were smaller than those with CF2, they were still larger than those with CF1 (Figs. 6 and 7). We tried increasing the maximum degree of CF3 from two to three, but the fluctuations did not improve (not shown). The fluctuations are due directly to aoh and adh, but did not appear in ath [Fig. 5(b)]. This indicates that the noise in aoh and adh should be removed in order to reduce the noise in cth. Next, the melanin images from CF3 show what seem to be veins [Fig. 6(e)]. This comes from the am image [Fig. 5(a)], and the compensation did not seem to work well without a0. Although the average values for CF3 were the same as those for CF1 (Fig. 7), this can create a serious problem in visual understanding. To reduce these problems, although the regression coefficients for the MRA1 will be converted to chromophore concentrations with CFs, maximizing the accuracy of MRA1 may be effective in terms of the propagation of errors. This means that the more linear the relationship between the regression coefficients of MRA1 and the respective chromophore concentrations, the smaller the estimation error will become. Therefore, for MRA1, employing the modified B–L method instead of the simple B–L method may be effective, because this will improve the correlation between the concentration and the respective regression coefficients of MRA1.

This technique for reducing the shading-derived error does not require any measurements or assumptions about the shape of the subjects and has no limitations as to skin type. In addition, the method is robust against the angular distribution of the reflected light, as discussed in the previous paragraph. However, the method as a whole has inherited some limitations from the base method. First, the estimated chromophore concentrations depend on the optical parameters and geometries used in the MCS. The thicknesses and scattering coefficients of the epidermis and dermis layer can vary with the individual, the site, and the condition of the skin (e.g., water content). Second, an adequate amount of light should be reflected from the dermis for a precise evaluation of the chromophore concentrations. In the case of darker skin, light is strongly absorbed in the epidermis, and the intensity of the light that reaches the dermis is weak. As a consequence, the error in the estimation of the chromophore concentration, especially of oxygenated and deoxygenated hemoglobin, will be larger than that for lighter skin.

In the case of oily skin, the specular reflection is stronger than that of nonoily skin, but this was corrected by using a polarizer in our measuring system. However, the amount of sebum will affect the scattering power of the epidermis, and thus it will also affect the estimated chromophore concentration. The existence of sebum is expected to decrease the scattering power of the surface of the epidermis and thus increase the penetration depth. This may result in an overestimation of the chromophores.

This method is very useful for the diagnoses of skin spots or lesions, especially when they are so large that the surface curvature becomes non-negligible; an example of this is a port-wine stain.26 Also, in aesthetic evaluations in dermatology and cosmetology, evaluations of each body part (especially the face) as a whole are important.27 The robustness of this method against fluctuations in the intensity of the light source provide a practical advantage. In practical applications, the intensity of the light source is sometime not stable; for example, when using a flashbulb. However, to the extent that the spectrum of the light source is proportional, the derived chromophore concentrations will not be affected, since the effect is gathered into a0 in MRA1. This method is not limited to imaging: it can also be used for point measurements when the stability of the light source intensity cannot be guaranteed. On the other hand, the method cannot be applied when wavelength-dependent information cannot be utilized, such as for the derivation of the absorption and reduced scattering coefficient μa and μs.16,28 In this case, the effect of shading will also cause errors in the estimated concentrations of chromophores.

In this article, we presented a method for quantitative evaluation of skin chromophores over wide regions. We achieved the reduction of shading-derived artifact by eliminating the constant term of the B–L method in the conversion of the regression coefficients to concentrations. This method is robust to errors in estimating the irradiance and also accounts for the scattering effect. Measurements of a forearm confirmed that, by optimizing the CF, the proposed approach can dramatically reduce the shading-derived artifacts and fully account for the scattering effect. The proposed approach will enable more accurate imaging of large areas, such as whole arms, hands, faces, or legs. Although the method has problems with noise and artifacts, these can be overcome by applying the modified B–L method to MRA1. This issue should be further investigated.

Nishidate  I., Aizu  Y., Mishina  H., “Estimation of melanin and hemoglobin in skin tissue using multiple regression analysis aided by Monte Carlo simulation,” J. Biomed. Opt.. 9, (4 ), 700 –710 (2004).CrossRef 1083-3668 
Yamamoto  S. et al., “Optical path-length matrix method for estimating skin spectrum,” Opt. Rev.. 19, (6 ), 361 –365 (2012).CrossRef 1340-6000 
Dawson  J. B. et al., “A theoretical and experimental study of light absorption and scattering by in vivo skin,” Phys. Med. Biol.. 25, (4 ), 695 –709 (1980).CrossRef 0031-9155 
Shimada  M. et al., “Explanation of human skin color by multiple linear regression analysis based on the modified Lambert-Beer law,” Opt. Rev.. 7, (4 ), 348 –352 (2000).CrossRef 1340-6000 
Välisuo  P. et al., “New closed-form approximation for skin chromophore mapping,” J. Biomed. Opt.. 16, (4 ), 046012  (2011).CrossRef 1083-3668 
Maeda  T. et al., “Monte Carlo simulation of spectral reflectance using a multilayered skin tissue model,” Opt. Rev.. 17, (3 ), 223 –229 (2010).CrossRef 1340-6000 
Jacques  S. L., Samatham  R., Choudhury  N., “Rapid spectral analysis for spectral imaging,” Biomed. Opt. Express. 1, (1 ), 157 –164 (2010).CrossRef 2156-7085 
Claridge  E. et al., “From colour to tissue histology: physics-based interpretation of images of pigmented skin lesions,” Med. Image Anal.. 7, (4 ), 489 –502 (2003).CrossRef 1361-8415 
Nishidate  I. et al., “Noninvasive spectral imaging of skin chromophores based on multiple regression analysis aided by Monte Carlo simulation,” Opt. Lett.. 36, (16 ), 3239 –3241 (2011).CrossRef 0146-9592 
Tsumura  N. et al., “Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin,” ACM Trans. Graphics. 22, (3 ), 770 –779 (2003).CrossRef 0730-0301 
Prigent  S. et al., “Multi-spectral image analysis for skin pigmentation classification,” in  2010 17th IEEE Int. Conf. Image Process. (ICIP) ,  Hong Kong , pp. 3641 –3644 (2010).
Kainerstorfer  J. M. et al., “Direct curvature correction for noncontact imaging modalities applied to multispectral imaging,” J. Biomed. Opt.. 15, (4 ), 046013  (2010).CrossRef 1083-3668 
Sun  J., Smith  M., “Multidimensional imaging for skin tissue surface characterization,” Comput. Ind.. 64, (9 ), 1383 –1389 (2013).CrossRef 0166-3615 
Uludag  K. et al., “Cross talk in the Lambert-Beer calculation for near-infrared wavelengths estimated by Monte Carlo simulations,” J. Biomed. Opt.. 7, (1 ), 51 –59 (2002).CrossRef 1083-3668 
Okui  N., Okada  E., “Wavelength dependence of crosstalk in dual-wavelength measurement of oxy- and deoxy-hemoglobin,” J. Biomed. Opt.. 10, (1 ), 011015  (2005).CrossRef 1083-3668 
Nguyen  T. T. A. et al., “Three-dimensional phantoms for curvature correction in spatial frequency domain imaging,” Biomed. Opt. Express. 3, (6 ), 1200 –1214 (2012).CrossRef 2156-7085 
Wang  L. H., Jacques  S. L., Zheng  L. Q., “MCML—Monte Carlo modeling of light transport in multi-layered tissues,” Comput. Methods Programs Biomed.. 47, (2 ), 131 –146 (1995).CrossRef 0169-2607 
Jacques  S. L., McAuliffe  D. J., “The melanosome: threshold temperature for explosive vaporization and internal absorption coefficient during pulsed laser irradiation,” Photochem. Photobiol.. 53, (6 ), 769 –775 (1991). 0031-8655 
Prahl  S. A., “Optical absorption of hemoglobin,” http//omlc.ogi.edu/spectra/hemoglobin/index.html (1999).
Jacques  S. L., “Origins of tissue optical properties in the UVA, visible, and NIR regions,” pp. 364 –369,  Optical Society of America (OSA) ,  Washington, DC  (1996).
van Gemert  M. J. C. et al., “Skin optics,” IEEE Trans. Biomed. Eng.. 36, (12 ), 1146 –1154 (1989).CrossRef 0018-9294 
Jacques  S. L., “Skin optics summary,” http://omlc.ogi.edu/news/jan98/skinoptics.html OMLC news Jan 1998 (1998).
Nishidate  I., Aizu  Y., Mishina  H., “Estimation of absorbing components in a local layer embedded in the turbid media on the basis of visible to near-infrared (VIS-NIR) reflectance spectra,” Opt. Rev.. 10, (5 ), 427 –435 (2003).CrossRef 1340-6000 
Oren  M., Nayer  S. K., “Generalization of Lambert’s reflectance model,” in  SIGGRAPH ‘94 Proc. 21st Ann. Conf. Comput. Graphics Interact. Tech. , pp. 239 –246,  ACM ,  New York  (1994).10.1145/192161.192213
Forst  T. et al., “Reliability of lightguide spectrophotometry (O2C®) for the investigation of skin tissue microvascular blood flow and tissue oxygen supply in diabetic and nondiabetic subjects,” J. Diabetes Sci. Technol.. 2, (6 ), 1151 –1156 (2008).
Jung  B. et al., “Characterization of port wine stain skin erythema and melanin content using cross-polarized diffuse reflectance imaging,” Lasers Surg. Med.. 34, (2 ), 174 –181 (2004).CrossRef 0196-8092 
Ojima  N. et al., “Application of image-based skin chromophore analysis to cosmetics,” J. Imaging Sci. Technol.. 48, (3 ), 222 –226, 236–238 (2004). 1062-3701 
Gioux  S. et al., “Three-dimensional surface profile intensity correction for spatially modulated imaging,” J. Biomed. Opt.. 14, (3 ), 034045  (2009).CrossRef 1083-3668 

Biographies of the authors are not available.

© The Authors. Published by SPIE under a Creative Commons Attribution 3.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.

Citation

Kenichiro Yoshida ; Izumi Nishidate ; Nobutoshi Ojima and Kayoko Iwata
"Reduction of shading-derived artifacts in skin chromophore imaging without measurements or assumptions about the shape of the subject", J. Biomed. Opt. 19(1), 016009 (Jan 09, 2014). ; http://dx.doi.org/10.1117/1.JBO.19.1.016009


Figures

Graphic Jump LocationF1 :

Notation of positional and angular relationships for a point on a cylindrical subject in relation to a light source and a camera. Each symbol represents S: light vector, N: normal vector, V: viewing vector, θi: incident angle, θo: viewing angle, θS: angle between S and V, r: radius of the cylindrical subject, (x0,y0): coordinate value of a point on the subject.

Graphic Jump LocationF2 :

Schematic of the measuring system.

Graphic Jump LocationF3 :

Correlations between the original and the estimated values of (a) melanin and (b) hemoglobin, using CF1; (c) melanin and (d) hemoglobin, using CF2; and (e) melanin and (f) hemoglobin, using CF3. Horizontal axis: original values; vertical axis: estimated values. The unit of the horizontal and vertical axes is %.

Graphic Jump LocationF4 :

Representative example of measured images (appearance) from different angles. The inner side of the forearm faced (a) straight or (b) upward. The hand is to the left side. To correlate the positions, points were marked in a reticular pattern. The symbols drawn on the pictures are the measured points for Fig. 8. The framed area in (a) is the area shown in Figs. 5 and 6.

Graphic Jump LocationF5 :

Representative example of images of the multiple regression coefficients: (a) am; (b) ath (=aoh+adh); (c) aoh; (d) adh; (e) a0; and (f) aStO2 (=aoh/ath). The area of the images is the area surrounded by a border in Fig. 4(a). The background is masked in black. The value of each regression coefficient corresponds to the brightness. The lower limit is zero for all images, and the upper limit (“Max”) is 5×104 for am, 4×106 for ath, 1×106 for aoh, 1×106 for adh, 1 for a0, and 100% for aStO2. The reticular pattern is made up of points marked on the skin, and it can be clearly seen in (e).

Graphic Jump LocationF6 :

Estimated cm and cth with each CF. (a)–(b) with CF1: (a) cm and (b) cth; (c)–(d) with CF2: (c) cm and (d) cth; (e)–(f) with CF3: (e) cm and (f) cth. The value of each estimated concentration corresponds to the brightness; the lower limit is zero for all images, and the upper limit (“Max”) is 10% and 0.25% for the images of cm and cth, respectively. The dotted line and the characters “X” and “Y” in (a) represent the cross-section and ends represented in Fig. 7. The background is masked in black. The reticular pattern is made up of points marked on the skin.

Graphic Jump LocationF7 :

Cross-sections of the estimated (a) cm and (b) cth, with CF1, CF2, and CF3. CF1: gray broken lines, CF2: dotted lines, CF3: solid black lines. The plots shown above are the magnified figures of the framed areas. The cross-sections were taken along the dotted lines in Fig. 6(a), and the sides X and Y correspond to the positions noted in Fig. 6(a). The unit of the vertical axes is %.

Graphic Jump LocationF8 :

Correlation between the estimates from different angles (angles 1 and 2) of the melanin and the hemoglobin concentrations at each position of the representative example (same subject as in Fig. 4). (a)–(b): cm calculated with (a) CF1 and (b) CF3; (c)–(d): cth calculated with (c) CF1 and (d) CF3. The symbols and legend (A to D) are the same as those used in Fig. 4. The unit of the horizontal and vertical axes is %.

Graphic Jump LocationF9 :

Correlation between the estimates from different angles (angles 1 and 2) of the melanin and the hemoglobin concentrations at each position for all subjects. (a): cm; (b): cth calculated with CF3. The diagonal solid line represents y=x, and the diagonal gray broken line represents y=x±1.96σ, which is the 95% confidence interval assuming the V follows a Gaussian distribution. The unit of the horizontal and vertical axes is %.

Tables

References

Nishidate  I., Aizu  Y., Mishina  H., “Estimation of melanin and hemoglobin in skin tissue using multiple regression analysis aided by Monte Carlo simulation,” J. Biomed. Opt.. 9, (4 ), 700 –710 (2004).CrossRef 1083-3668 
Yamamoto  S. et al., “Optical path-length matrix method for estimating skin spectrum,” Opt. Rev.. 19, (6 ), 361 –365 (2012).CrossRef 1340-6000 
Dawson  J. B. et al., “A theoretical and experimental study of light absorption and scattering by in vivo skin,” Phys. Med. Biol.. 25, (4 ), 695 –709 (1980).CrossRef 0031-9155 
Shimada  M. et al., “Explanation of human skin color by multiple linear regression analysis based on the modified Lambert-Beer law,” Opt. Rev.. 7, (4 ), 348 –352 (2000).CrossRef 1340-6000 
Välisuo  P. et al., “New closed-form approximation for skin chromophore mapping,” J. Biomed. Opt.. 16, (4 ), 046012  (2011).CrossRef 1083-3668 
Maeda  T. et al., “Monte Carlo simulation of spectral reflectance using a multilayered skin tissue model,” Opt. Rev.. 17, (3 ), 223 –229 (2010).CrossRef 1340-6000 
Jacques  S. L., Samatham  R., Choudhury  N., “Rapid spectral analysis for spectral imaging,” Biomed. Opt. Express. 1, (1 ), 157 –164 (2010).CrossRef 2156-7085 
Claridge  E. et al., “From colour to tissue histology: physics-based interpretation of images of pigmented skin lesions,” Med. Image Anal.. 7, (4 ), 489 –502 (2003).CrossRef 1361-8415 
Nishidate  I. et al., “Noninvasive spectral imaging of skin chromophores based on multiple regression analysis aided by Monte Carlo simulation,” Opt. Lett.. 36, (16 ), 3239 –3241 (2011).CrossRef 0146-9592 
Tsumura  N. et al., “Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin,” ACM Trans. Graphics. 22, (3 ), 770 –779 (2003).CrossRef 0730-0301 
Prigent  S. et al., “Multi-spectral image analysis for skin pigmentation classification,” in  2010 17th IEEE Int. Conf. Image Process. (ICIP) ,  Hong Kong , pp. 3641 –3644 (2010).
Kainerstorfer  J. M. et al., “Direct curvature correction for noncontact imaging modalities applied to multispectral imaging,” J. Biomed. Opt.. 15, (4 ), 046013  (2010).CrossRef 1083-3668 
Sun  J., Smith  M., “Multidimensional imaging for skin tissue surface characterization,” Comput. Ind.. 64, (9 ), 1383 –1389 (2013).CrossRef 0166-3615 
Uludag  K. et al., “Cross talk in the Lambert-Beer calculation for near-infrared wavelengths estimated by Monte Carlo simulations,” J. Biomed. Opt.. 7, (1 ), 51 –59 (2002).CrossRef 1083-3668 
Okui  N., Okada  E., “Wavelength dependence of crosstalk in dual-wavelength measurement of oxy- and deoxy-hemoglobin,” J. Biomed. Opt.. 10, (1 ), 011015  (2005).CrossRef 1083-3668 
Nguyen  T. T. A. et al., “Three-dimensional phantoms for curvature correction in spatial frequency domain imaging,” Biomed. Opt. Express. 3, (6 ), 1200 –1214 (2012).CrossRef 2156-7085 
Wang  L. H., Jacques  S. L., Zheng  L. Q., “MCML—Monte Carlo modeling of light transport in multi-layered tissues,” Comput. Methods Programs Biomed.. 47, (2 ), 131 –146 (1995).CrossRef 0169-2607 
Jacques  S. L., McAuliffe  D. J., “The melanosome: threshold temperature for explosive vaporization and internal absorption coefficient during pulsed laser irradiation,” Photochem. Photobiol.. 53, (6 ), 769 –775 (1991). 0031-8655 
Prahl  S. A., “Optical absorption of hemoglobin,” http//omlc.ogi.edu/spectra/hemoglobin/index.html (1999).
Jacques  S. L., “Origins of tissue optical properties in the UVA, visible, and NIR regions,” pp. 364 –369,  Optical Society of America (OSA) ,  Washington, DC  (1996).
van Gemert  M. J. C. et al., “Skin optics,” IEEE Trans. Biomed. Eng.. 36, (12 ), 1146 –1154 (1989).CrossRef 0018-9294 
Jacques  S. L., “Skin optics summary,” http://omlc.ogi.edu/news/jan98/skinoptics.html OMLC news Jan 1998 (1998).
Nishidate  I., Aizu  Y., Mishina  H., “Estimation of absorbing components in a local layer embedded in the turbid media on the basis of visible to near-infrared (VIS-NIR) reflectance spectra,” Opt. Rev.. 10, (5 ), 427 –435 (2003).CrossRef 1340-6000 
Oren  M., Nayer  S. K., “Generalization of Lambert’s reflectance model,” in  SIGGRAPH ‘94 Proc. 21st Ann. Conf. Comput. Graphics Interact. Tech. , pp. 239 –246,  ACM ,  New York  (1994).10.1145/192161.192213
Forst  T. et al., “Reliability of lightguide spectrophotometry (O2C®) for the investigation of skin tissue microvascular blood flow and tissue oxygen supply in diabetic and nondiabetic subjects,” J. Diabetes Sci. Technol.. 2, (6 ), 1151 –1156 (2008).
Jung  B. et al., “Characterization of port wine stain skin erythema and melanin content using cross-polarized diffuse reflectance imaging,” Lasers Surg. Med.. 34, (2 ), 174 –181 (2004).CrossRef 0196-8092 
Ojima  N. et al., “Application of image-based skin chromophore analysis to cosmetics,” J. Imaging Sci. Technol.. 48, (3 ), 222 –226, 236–238 (2004). 1062-3701 
Gioux  S. et al., “Three-dimensional surface profile intensity correction for spatially modulated imaging,” J. Biomed. Opt.. 14, (3 ), 034045  (2009).CrossRef 1083-3668 

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Related Book Chapters

Topic Collections

PubMed Articles
Advertisement
  • Don't have an account?
  • Subscribe to the SPIE Digital Library
  • Create a FREE account to sign up for Digital Library content alerts and gain access to institutional subscriptions remotely.
Access This Article
Sign in or Create a personal account to Buy this article ($20 for members, $25 for non-members).
Access This Proceeding
Sign in or Create a personal account to Buy this article ($15 for members, $18 for non-members).
Access This Chapter

Access to SPIE eBooks is limited to subscribing institutions and is not available as part of a personal subscription. Print or electronic versions of individual SPIE books may be purchased via SPIE.org.