Weakly supervised airway orifice segmentation in video bronchoscopy

Ron Keuth; Mattias Heinrich; Martin Eichenlaub; Marian Himstedt

doi:10.1117/12.2654229

3 April 2023 Weakly supervised airway orifice segmentation in video bronchoscopy

Ron Keuth, Mattias Heinrich, Martin Eichenlaub, Marian Himstedt

Proceedings Volume 12464, Medical Imaging 2023: Image Processing; 124640A (2023) https://doi.org/10.1117/12.2654229
Event: SPIE Medical Imaging, 2023, San Diego, California, United States

Abstract

Video bronchoscopy is routinely conducted for biopsies of lung tissue suspected for cancer, monitoring of COPD patients and clarification of acute respiratory problems at intensive care units. The navigation within complex bronchial trees is particularly challenging and physically demanding, requiring long-term experiences of physicians. This paper addresses the automatic segmentation of bronchial orifices in bronchoscopy videos. Deep learning-based approaches to this task are currently hampered due to the lack of readily available ground truth segmentation data. Thus, we present a data-driven pipeline consisting of a k-means followed by a compact marker-based watershed algorithm which enables to generate airway instance segmentation maps from given depth images. In this way, these traditional algorithms serve as weak supervision for training a shallow CNN directly on RGB images solely based on a phantom dataset. We evaluate generalization capabilities of this model on two in-vivo datasets covering 250 frames on 21 different bronchoscopies. We demonstrate that the model is capable to transfer its knowledge to the unseen in-vivo domain, reaching an average error of 4.35 vs 7.98 pixels for detected centroids of airway segmentations by an image resolution of 128 × 128. Our quantitative and qualitative results indicate that in the context of video bronchoscopy, phantom data and weak supervision using non-learning-based approaches enable to gain a semantic understanding of airway structures

Conference Presentation

Citation Download Citation

Ron Keuth, Mattias Heinrich, Martin Eichenlaub, and Marian Himstedt "Weakly supervised airway orifice segmentation in video bronchoscopy", Proc. SPIE 12464, Medical Imaging 2023: Image Processing, 124640A (3 April 2023); https://doi.org/10.1117/12.2654229

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available