TY - GEN
T1 - Determining Performance of Computer Vision Models using Generalizability, Robustness & Elasticity Score
AU - Omer, Aishwarye
AU - Nguyen, Hien
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Performance measurement of computer vision models provides information about their ability to classify objects. However, their performance gets affected in the real-world environment. We propose a modification for the metric called Generalizability, Robustness, and Elasticity score (GRE), which is used to determine the efficiency of the computer vision models. Specifically, we use unaltered Visual Question Answering (VQA) datasets and develop three new datasets for each attribute of the GRE score. The new datasets pass through three novel serial processes designed to enhance the quality of the datasets. The new datasets have a better distribution of feature information of the objects in the original dataset. Their performance is measured by running the datasets on three models specifically modified for our experiment. Two out of three models perform better on our new datasets and provide a better GRE score. We prove that our system works and can provide better results than the conventional method of measuring the performance of computer vision models.
AB - Performance measurement of computer vision models provides information about their ability to classify objects. However, their performance gets affected in the real-world environment. We propose a modification for the metric called Generalizability, Robustness, and Elasticity score (GRE), which is used to determine the efficiency of the computer vision models. Specifically, we use unaltered Visual Question Answering (VQA) datasets and develop three new datasets for each attribute of the GRE score. The new datasets pass through three novel serial processes designed to enhance the quality of the datasets. The new datasets have a better distribution of feature information of the objects in the original dataset. Their performance is measured by running the datasets on three models specifically modified for our experiment. Two out of three models perform better on our new datasets and provide a better GRE score. We prove that our system works and can provide better results than the conventional method of measuring the performance of computer vision models.
UR - http://www.scopus.com/inward/record.url?scp=85133944873&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85133944873&partnerID=8YFLogxK
U2 - 10.1109/CSCI54926.2021.00314
DO - 10.1109/CSCI54926.2021.00314
M3 - Conference contribution
AN - SCOPUS:85133944873
T3 - Proceedings - 2021 International Conference on Computational Science and Computational Intelligence, CSCI 2021
SP - 1634
EP - 1638
BT - Proceedings - 2021 International Conference on Computational Science and Computational Intelligence, CSCI 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2021 International Conference on Computational Science and Computational Intelligence, CSCI 2021
Y2 - 15 December 2021 through 17 December 2021
ER -