TY - JOUR
T1 - Interpretation of historic structure for non-invasive assessment using eye tracking
AU - Saleem, M. R.
AU - Straus, A.
AU - Napolitano, R.
N1 - Publisher Copyright:
© 2021 International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives. All Rights Reserved.
PY - 2021/9/10
Y1 - 2021/9/10
N2 - With the aims of ensuring safety and decreasing maintenance costs, previous studies in bridge inspection research have worked to elucidate damage indicators and understand their correspondence to structural deficiency. During this process, understanding how an inspector looks at a structure comprehensively as well as how they localize on damage is vital to examining diagnostic bias and how it can play a role in the preservation and maintenance process. To understand human perception and assess the humaninfrastructure interaction during the feature extraction process, eye tracking can be useful. Eye tracking data can accurately map where a human is looking and what they are focusing on based on metrics such as fixation, saccade, pupil dilation, and scan path. The present research highlights the use of eye tracking metrics for recognizing and inferring human implicit attention and intention while performing a structural inspection. These metrics will be used to learn the behavior of human eyes and how detection tasks can change a person's overall behavior. A preliminary study has been carried out for damage detection to analyze key features that are important for understanding human-infrastructure interaction during damage assessment. These eye tracking features will lay the foundation for human intent prediction and how an inspector performs inspection on historic structures for existing types of damage. In future, the results of this work will be used to train a machine learning agent for autonomous and reactive decision making.
AB - With the aims of ensuring safety and decreasing maintenance costs, previous studies in bridge inspection research have worked to elucidate damage indicators and understand their correspondence to structural deficiency. During this process, understanding how an inspector looks at a structure comprehensively as well as how they localize on damage is vital to examining diagnostic bias and how it can play a role in the preservation and maintenance process. To understand human perception and assess the humaninfrastructure interaction during the feature extraction process, eye tracking can be useful. Eye tracking data can accurately map where a human is looking and what they are focusing on based on metrics such as fixation, saccade, pupil dilation, and scan path. The present research highlights the use of eye tracking metrics for recognizing and inferring human implicit attention and intention while performing a structural inspection. These metrics will be used to learn the behavior of human eyes and how detection tasks can change a person's overall behavior. A preliminary study has been carried out for damage detection to analyze key features that are important for understanding human-infrastructure interaction during damage assessment. These eye tracking features will lay the foundation for human intent prediction and how an inspector performs inspection on historic structures for existing types of damage. In future, the results of this work will be used to train a machine learning agent for autonomous and reactive decision making.
UR - http://www.scopus.com/inward/record.url?scp=85118561932&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85118561932&partnerID=8YFLogxK
U2 - 10.5194/isprs-Archives-XLVI-M-1-2021-653-2021
DO - 10.5194/isprs-Archives-XLVI-M-1-2021-653-2021
M3 - Conference article
AN - SCOPUS:85118561932
SN - 1682-1750
VL - 46
SP - 653
EP - 660
JO - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
JF - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
IS - M-1-2021
T2 - 28th CIPA Symposium on Great Learning and Digital Emotion, CIPA 2021
Y2 - 28 August 2021 through 1 September 2021
ER -