Determining Performance of Computer Vision Models using Generalizability, Robustness & Elasticity Score

Aishwarye Omer, Hien Nguyen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Performance measurement of computer vision models provides information about their ability to classify objects. However, their performance gets affected in the real-world environment. We propose a modification for the metric called Generalizability, Robustness, and Elasticity score (GRE), which is used to determine the efficiency of the computer vision models. Specifically, we use unaltered Visual Question Answering (VQA) datasets and develop three new datasets for each attribute of the GRE score. The new datasets pass through three novel serial processes designed to enhance the quality of the datasets. The new datasets have a better distribution of feature information of the objects in the original dataset. Their performance is measured by running the datasets on three models specifically modified for our experiment. Two out of three models perform better on our new datasets and provide a better GRE score. We prove that our system works and can provide better results than the conventional method of measuring the performance of computer vision models.

Original languageEnglish (US)
Title of host publicationProceedings - 2021 International Conference on Computational Science and Computational Intelligence, CSCI 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1634-1638
Number of pages5
ISBN (Electronic)9781665458412
DOIs
StatePublished - 2021
Event2021 International Conference on Computational Science and Computational Intelligence, CSCI 2021 - Las Vegas, United States
Duration: Dec 15 2021Dec 17 2021

Publication series

NameProceedings - 2021 International Conference on Computational Science and Computational Intelligence, CSCI 2021

Conference

Conference2021 International Conference on Computational Science and Computational Intelligence, CSCI 2021
Country/TerritoryUnited States
CityLas Vegas
Period12/15/2112/17/21

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Signal Processing
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'Determining Performance of Computer Vision Models using Generalizability, Robustness & Elasticity Score'. Together they form a unique fingerprint.

Cite this