Quantitative polyp size measurements with photometric stereo endoscopy enhanced by deep learning (Conference Presentation)

Faisal Mahmood; Norman S. Nishioka M.D.; Nicholas J. Durr

doi:10.1117/12.2290423

14 March 2018 Quantitative polyp size measurements with photometric stereo endoscopy enhanced by deep learning (Conference Presentation)

Faisal Mahmood, Norman S. Nishioka M.D., Nicholas J. Durr

Author Affiliations +

Proceedings Volume 10487, Multimodal Biomedical Imaging XIII; 104870G (2018) https://doi.org/10.1117/12.2290423
Event: SPIE BiOS, 2018, San Francisco, California, United States

Abstract

Colorectal cancer is the second leading cause of cancer deaths in the United States. Identifying and removing premalignant lesions via colonoscopy can significantly reduce colorectal cancer mortality. Unfortunately, the protective value of screening colonoscopy is limited because more than one quarter of clinically-important lesions are missed on average. Most of these lesions are associated with characteristic 3D topographical shapes that appear subtle to a conventional colonoscope. Photometric stereo endoscopy captures this 3D structure but is inherently qualitative due to the unknown working distances from each point of the object to the endoscope. In this work, we use deep learning to estimate the depth from a monocular endoscope camera. Significant amounts of endoscopy data with known depth maps is required for training a convolutional neural network for deep learning. Moreover, this training problem is challenging because the colon texture is patient-specific and cannot be used to efficiently learn depth. To resolve these issues, we developed a photometric stereo endoscopy simulator and generated data with ground truth depths from a virtual, texture-free colon phantom. These data were used to train a deep convolutional neural field network that can estimate the depth for test data with an accuracy of 84%. We use this depth estimate to implement a smart photometric stereo algorithm that reconstructs absolute depth maps. Applying this technique to an in-vivo human colonoscopy video of a single polyp viewed at varying distance, initial results show a reduction in polyp size measurement variation from 15.5% with conventional to 3.4% with smart photometric reconstruction.

Conference Presentation

Citation Download Citation

Faisal Mahmood, Norman S. Nishioka M.D., and Nicholas J. Durr "Quantitative polyp size measurements with photometric stereo endoscopy enhanced by deep learning (Conference Presentation)", Proc. SPIE 10487, Multimodal Biomedical Imaging XIII, 104870G (14 March 2018); https://doi.org/10.1117/12.2290423

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
PRESENTATION

WATCH
PRESENTATION SAVE TO MY LIBRARY

GET CITATION

KEYWORDS

Endoscopy

Colorectal cancer

Colon

Endoscopes

Reconstruction algorithms

3D displays

3D metrology

Show All Keywords

Keywords/Phrases

Search In:

Publication Years