Raman microspectroscopy was used to examine the biochemical composition and molecular structure of extracellular matrix in spongy and subchondral bone collected from patients with clinical and radiological evidence of idiopathic osteoarthritis of the hip and from patients who underwent a femoral neck fracture, as a result of trauma, without previous clinical and radiological evidence of osteoarthritis. The objectives of the study were to determine the levels of mineralization, carbonate accumulation and collagen quality in bone tissue. The subchondral bone from osteoarthritis patients in comparison with control subject is less mineralized due to a decrease in the hydroxyapatite concentration. However, the extent of carbonate accumulation in the apatite crystal lattice increases, most likely due to deficient mineralization. The alpha helix to random coil band area ratio reveals that collagen matrix in subchondral bone is more ordered in osteoarthritis disease. The hydroxyapatite to collagen, carbonate apatite to hydroxyapatite and alpha helix to random coil band area ratios are not significantly changed in the differently loaded sites of femoral head. The significant differences also are not visible in mineral and organic constituents’ content in spongy bone beneath the subchondral bone in osteoarthritis disease.