Identification of kernels in a convolutional neural network: connections between the level set equation and deep learning for image segmentation

Jonas A. Actor; David T. Fuentes; Béatrice Rivière

doi:10.1117/12.2548871

10 March 2020 Identification of kernels in a convolutional neural network: connections between the level set equation and deep learning for image segmentation

Jonas A. Actor, David T. Fuentes, Béatrice Rivière

Author Affiliations +

Proceedings Volume 11313, Medical Imaging 2020: Image Processing; 1131317 (2020) https://doi.org/10.1117/12.2548871
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

Medical image segmentation remains a difficult, time-consuming task; currently, liver segmentation from abdominal CT scans is often done by hand, requiring too much time to construct patient-specific treatment models for hepatocellular carcinoma. Image segmentation techniques, such as level set methods and convolutional neural networks (CNN), rely on a series of convolutions and nonlinearities to construct image features: neural networks that use strictly mean-zero finite difference stencils as convolution kernels can be treated as upwind discretizations of differential equations. If this relationship can be made explicit, one gains the ability to analyze CNN using the language of numerical analysis, thereby providing a well-established framework for proving properties such as stability and approximation accuracy. We test this relationship by constructing a level set network, a type of CNN whose architecture describes the expansion of level sets; forward-propagation through a level set network is equivalent to solving the level set equation; the level set network achieves comparable segmentation accuracy to solving the level set equation, while not obtaining the accuracy of a common CNN architecture. We therefore analyze which convolution filters are present in a standard CNN, to see whether finite difference stencils are learned during training; we observe certain patterns that form at certain layers in the network, where the learned CNN kernels depart from known convolution kernels used to solve the level set equation.

Conference Presentation

Citation Download Citation

Jonas A. Actor, David T. Fuentes, and Béatrice Rivière "Identification of kernels in a convolutional neural network: connections between the level set equation and deep learning for image segmentation", Proc. SPIE 11313, Medical Imaging 2020: Image Processing, 1131317 (10 March 2020); https://doi.org/10.1117/12.2548871

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available