Comparing observer performance with mixture distribution analysis when there is no external gold standard

Harold L. Kundel; Marcia Polansky

doi:10.1117/12.306185

21 April 1998 Comparing observer performance with mixture distribution analysis when there is no external gold standard

Harold L. Kundel, Marcia Polansky

Proceedings Volume 3340, Medical Imaging 1998: Image Perception; (1998) https://doi.org/10.1117/12.306185
Event: Medical Imaging '98, 1998, San Diego, CA, United States

Abstract

Mixture distribution analysis (MDA) is proposed as a statistical methodology for comparing observer readings on different imaging modalities when the image findings cannot be independently verified. The study utilized a data set consisting of independent, blinded readings by 4 radiologists of a stratified sample of 95 bedside chest images obtained using computed radiography. Each case was rad on hard and soft copy. The area under the ROC curve (AUC) was calculated using ROCFIT and the relative percent correct (RPC) was calculated from point distributions estimated by the MDA. The expectation maximization algorithm was used to perform a maximum likelihood estimation of the fit to either 3, 4 or 5 point distributions. There was agreement between the AUC and the RPC based upon 3 point distributions representing easy normals, hard normals and abnormals, easy abnormals, hard normals, hard abnormals and easy abnormals. We conclude that the MDA may be a viable alternative to the ROC for evaluating observer performance on imaging modalities in clinical settings where image verification is either difficult or impossible.

Citation Download Citation

Harold L. Kundel and Marcia Polansky "Comparing observer performance with mixture distribution analysis when there is no external gold standard", Proc. SPIE 3340, Medical Imaging 1998: Image Perception, (21 April 1998); https://doi.org/10.1117/12.306185

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available