Insight, limitations, criticism, and interpretability of the use of activation functions in deep learning artificial neural networks

Jamilu Auwalu Adamu

doi:10.1117/12.2566098

20 August 2020 Insight, limitations, criticism, and interpretability of the use of activation functions in deep learning artificial neural networks

Jamilu Auwalu Adamu

Author Affiliations +

Proceedings Volume 11469, Emerging Topics in Artificial Intelligence 2020; 114691K (2020) https://doi.org/10.1117/12.2566098
Event: SPIE Nanoscience + Engineering, 2020, Online Only

Conference Poster

Abstract

The existing neural networks activation functions, the Sigmoid among others is the only set uses across various applications of NNs such as microscopy, neuromorphic, optical, robotics, finance and transportation. Only one set applies to different areas of application. Also, these activation functions’ selections are based on trial and error, neither emanate from the AI and or training datasets, nor from the testing data. This formed NNs’ Black-box. Jamilu (2019) proposed that strong links between the AI and or training datasets and activation functions must be established. This is to replace the NNs’ Black-box models with the models rely much less on experts’ assumptions, and much more on input AI and or training datasets, time change and specific area of application. Thus, Jamilu (2019) proposed Criterion(s) for the rational selection of activation functions. The paper is to use superintelligent NNs for stock price predictions, portfolio optimization, and general application approaches to shed light on the paper’ title.

Conference Presentation

Citation Download Citation

Jamilu Auwalu Adamu "Insight, limitations, criticism, and interpretability of the use of activation functions in deep learning artificial neural networks", Proc. SPIE 11469, Emerging Topics in Artificial Intelligence 2020, 114691K (20 August 2020); https://doi.org/10.1117/12.2566098

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available