Physical environment virtualization for human activities recognition

Azin Poshtkar, Vinayak Elangovan, Amir Shirkhodaie, Alex Chan, Shuowen Hu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations


Human activity recognition research relies heavily on extensive datasets to verify and validate performance of activity recognition algorithms. However, obtaining real datasets are expensive and highly time consuming. A physics-based virtual simulation can accelerate the development of context based human activity recognition algorithms and techniques by generating relevant training and testing videos simulating diverse operational scenarios. In this paper, we discuss in detail the requisite capabilities of a virtual environment to aid as a test bed for evaluating and enhancing activity recognition algorithms. To demonstrate the numerous advantages of virtual environment development, a newly developed virtual environment simulation modeling (VESM) environment is presented here to generate calibrated multisource imagery datasets suitable for development and testing of recognition algorithms for context-based human activities. The VESM environment serves as a versatile test bed to generate a vast amount of realistic data for training and testing of sensor processing algorithms. To demonstrate the effectiveness of VESM environment, we present various simulated scenarios and processed results to infer proper semantic annotations from the high fidelity imagery data for human-vehicle activity recognition under different operational contexts.

Original languageEnglish (US)
Title of host publicationModeling and Simulation for Defense Systems and Applications X
EditorsEric J. Kelmelis
ISBN (Electronic)9781628415940
StatePublished - Jan 1 2015
EventModeling and Simulation for Defense Systems and Applications X - Baltimore, United States
Duration: Apr 21 2015 → …

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X


OtherModeling and Simulation for Defense Systems and Applications X
Country/TerritoryUnited States
Period4/21/15 → …

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering


Dive into the research topics of 'Physical environment virtualization for human activities recognition'. Together they form a unique fingerprint.

Cite this