Enhancing inference time and memory utilization for machine learning in resource constrained internet of battlefield things

Bimal Ghimire; Danda B. Rawat

doi:10.1117/12.2621287

6 June 2022 Enhancing inference time and memory utilization for machine learning in resource constrained internet of battlefield things

Bimal Ghimire, Danda B. Rawat

Author Affiliations +

Proceedings Volume 12113, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications IV; 121131H (2022) https://doi.org/10.1117/12.2621287
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Abstract

Convolution Neural Network (CNN) models have demonstrated remarkable success for many applications including computer vision in recent years. However, the increase in accuracy achieved so far is at the cost of memory and complex computations. The CNN models are growing deeper and wider making it difficult to be fit in a single device that has limited resources. Moreover, the inference time of such models is large enough to be unfit to apply for the real-time mission critical applications like the Internet of Battlefield Things (IoBT). In IoBT, where the unmanned aerial vehicles (UAVs) flying in the battlefield zone and capturing images, require accurate learning and immediate inference. It becomes problematic if the learning model does not fit in a single UAV when it has limited resources. Considering the aforementioned issues, in this paper, we study a formal approach to improve the inference time and memory utilization in resource constrained IoBT. We consider that multiple UAVs are involved in the inference process in which we apply spatially parallel convolution and pooling operations for all the convolution layers and pooling layers as well as model parallelism for fully connected (FC) layers. Finally, we present the numerical results for varying number of participating UAVs, input data/image sizes, and communication speeds.

Conference Presentation

Citation Download Citation

Bimal Ghimire and Danda B. Rawat "Enhancing inference time and memory utilization for machine learning in resource constrained internet of battlefield things", Proc. SPIE 12113, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications IV, 121131H (6 June 2022); https://doi.org/10.1117/12.2621287

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available