A synthetic dataset for evaluating soft and hard fusion algorithms

Jacob L. Graham, David L. Hall, Jeffrey Rimland

Research output: Chapter in Book/Report/Conference proceedingConference contribution

23 Scopus citations


There is an emerging demand for the development of data fusion techniques and algorithms that are capable of combining conventional "hard" sensor inputs such as video, radar, and multispectral sensor data with "soft" data including textual situation reports, open-source web information, and "hard/soft" data such as image or video data that includes human-generated annotations. New techniques that assist in sense-making over a wide range of vastly heterogeneous sources are critical to improving tactical situational awareness in counterinsurgency (COIN) and other asymmetric warfare situations. A major challenge in this area is the lack of realistic datasets available for test and evaluation of such algorithms. While "soft" message sets exist, they tend to be of limited use for data fusion applications due to the lack of critical message pedigree and other metadata. They also lack corresponding hard sensor data that presents reasonable "fusion opportunities" to evaluate the ability to make connections and inferences that span the soft and hard data sets. This paper outlines the design methodologies, content, and some potential use cases of a COIN-based synthetic soft and hard dataset created under a United States Multi-disciplinary University Research Initiative (MURI) program funded by the U.S. Army Research Office (ARO). The dataset includes realistic synthetic reports from a variety of sources, corresponding synthetic hard data, and an extensive supporting database that maintains "ground truth" through logical grouping of related data into "vignettes."The supporting database also maintains the pedigree of messages and other critical metadata.

Original languageEnglish (US)
Title of host publicationDefense Transformation and Net-Centric Systems 2011
StatePublished - 2011
EventDefense Transformation and Net-Centric Systems 2011 - Orlando, FL, United States
Duration: Apr 27 2011Apr 28 2011

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X


OtherDefense Transformation and Net-Centric Systems 2011
Country/TerritoryUnited States
CityOrlando, FL

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'A synthetic dataset for evaluating soft and hard fusion algorithms'. Together they form a unique fingerprint.

Cite this