We previously developed a self-referencing differential spectroscopic (SRDS) method to detect lesions by identifying a spectroscopic biomarker of breast cancer, i.e., the specific tumor component (STC). The SRDS method is based on the assumption of the exclusive presence of this spectroscopic biomaker in malignant disease. Although clinical results using this method have already been published, the dependence of the STC spectra on the choice of reference tissue has not yet been addressed. In this study, we explore the impact of the selection of the reference region size and location on the STC spectrum in 10 subjects with malignant breast tumors. Referencing from both contralateral and ipsilateral sides was performed. Regardless of the referencing, we are able to obtain consistent high contrast images of malignant lesions using the STC with less than 13% deviation. These results suggest that the STC measurements are independent of any type, location, and amount of normal breast tissue used for referencing. This confirms the initial assumption of the SRDS analysis, that there are specific tumor components in cancer that do not exist in normal tissue. This also indicates that bilateral measurements are not required for lesion identification using the STC method.