Application of multidomain data fusion, machine learning and feature learning paradigms towards enhanced image-based SAR class vehicle recognition

Ferris I. Arnous, Ram M. Narayanan, Bing C. Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations


Deep convolutional neural networks (CNNs) provide the sensing and detection community with a discriminative, machine learning based approach for classifying images of objects. However, one of the largest limitations for deep CNN image classifiers is the need for extensive training data for a variety of appearances of class objects. While current methods such as GAN data augmentation, noise-perturbation, and rotation or translation of images can allow CNNs to better associate convolved features to ones similar to a learned image class, many fail to provide new context of ground truth information associated with each object class. To expand the association of new convolved feature examples with image classes within CNN training datasets, we propose a feature learning and training data enhancement paradigm via a multi-sensor domain data augmentation algorithm. This algorithm uses a mutual information, merit-based feature selection subroutine to iteratively select SAR object features that most correlate to each sensor domain's class image objects. It then re-augments these features into the opposite sensor domain's feature set via a highest mutual information, cross sensor domain image concatenation function. This augmented set then acts to retrain the CNN to recognize new cross domain class object features that each respective sensor domain's network was not previously exposed to. Our experimental results using T60- class vs T70-class SAR object images from both the MSTAR and MGTD dataset repositories demonstrated an increase in classification accuracy from 88% and 61% to post-augmented cross-domain dataset training of 93.75% accuracy for the MSTAR, MGTD and subsequent fused datasets, respectively.

Original languageEnglish (US)
Title of host publicationRadar Sensor Technology XXV
EditorsKenneth I. Ranney, Ann M. Raynal
ISBN (Electronic)9781510643215
StatePublished - 2021
EventRadar Sensor Technology XXV 2021 - Virtual, Online, United States
Duration: Apr 12 2021Apr 16 2021

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X


ConferenceRadar Sensor Technology XXV 2021
Country/TerritoryUnited States
CityVirtual, Online

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Application of multidomain data fusion, machine learning and feature learning paradigms towards enhanced image-based SAR class vehicle recognition'. Together they form a unique fingerprint.

Cite this