Enhancing Inference Time and Memory Utilization for Machine Learning in Resource Constrained Internet of Battlefield Things

Bimal Ghimire, Danda B. Rawat

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations


Convolution Neural Network (CNN) models have demonstrated remarkable success for many applications including computer vision in recent years. However, the increase in accuracy achieved so far is at the cost of memory and complex computations. The CNN models are growing deeper and wider making it difficult to be fit in a single device that has limited resources. Moreover, the inference time of such models is large enough to be unfit to apply for the real-time mission critical applications like the Internet of Battlefield Things (IoBT). In IoBT, where the unmanned aerial vehicles (UAVs) flying in the battlefield zone and capturing images, require accurate learning and immediate inference. It becomes problematic if the learning model does not fit in a single UAV when it has limited resources. Considering the aforementioned issues, in this paper, we study a formal approach to improve the inference time and memory utilization in resource constrained IoBT. We consider that multiple UAVs are involved in the inference process in which we apply spatially parallel convolution and pooling operations for all the convolution layers and pooling layers as well as model parallelism for fully connected (FC) layers. Finally, we present the numerical results for varying number of participating UAVs, input data/image sizes, and communication speeds.

Original languageEnglish (US)
Title of host publicationArtificial Intelligence and Machine Learning for Multi-Domain Operations Applications IV
EditorsTien Pham, Latasha Solomon
ISBN (Electronic)9781510651029
StatePublished - 2022
EventArtificial Intelligence and Machine Learning for Multi-Domain Operations Applications IV 2022 - Virtual, Online
Duration: Jun 6 2022Jun 12 2022

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X


ConferenceArtificial Intelligence and Machine Learning for Multi-Domain Operations Applications IV 2022
CityVirtual, Online

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this