Spatial variation of refractive index (RI) in connective tissues exhibits multifractality, which encodes useful morphological and ultrastructural information about the disease. We present a spectral Mueller matrix (MM)-based approach in combination with multifractal detrended fluctuation analysis (MFDFA) to exclusively pick out the signature of the underlying connective tissue multifractality through the superficial epithelium layer. The method is based on inverse analysis on selected spectral scattering MM elements encoding the birefringence information on the anisotropic connective tissue. The light scattering spectra corresponding to the birefringence carrying MM elements are then subjected to the Born approximation-based Fourier domain preprocessing to extract ultrastructural RI fluctuations of anisotropic tissue. The extracted RI fluctuations are subsequently analyzed via MFDFA to yield the multifractal tissue parameters. The approach was experimentally validated on a simple tissue model comprising of as scatterers of the superficial isotropic layer and rat tail collagen as an underlying anisotropic layer. Finally, the method enabled probing of precancer-related subtle alterations in underlying connective tissue ultrastructural multifractality from intact tissues.