TY - JOUR
T1 - Neural automated writing evaluation for Korean L2 writing
AU - Park, Jungyeul
AU - Lim, Kyungtae
AU - Song, Jayoung
AU - Park, Jungyeul
N1 - Publisher Copyright:
© The Author(s), 2022. Published by Cambridge University Press.
PY - 2023/9/7
Y1 - 2023/9/7
N2 - Although Korean language education is experiencing rapid growth in recent years and several studies have investigated automated writing evaluation (AWE) systems, AWE for Korean L2 writing still remains unexplored. Therefore, this study aims to develop and validate a state-of-The-Art neural model AWE system which can be widely used for Korean language teaching and learning. Based on a Korean learner corpus, the proposed AWE is developed using natural language processing techniques such as part-of-speech tagging, syntactic parsing, and statistical language modeling to engineer linguistic features and a pre-Trained neural language model. This study attempted to determine how neural network models use different linguistic features to improve AWE performance. Experimental results of the proposed AWE tool showed that the neural AWE system achieves high reliability for unseen test data from the corpus, which implies metrics used in the AWE system can help differentiate different proficiency levels and predict holistic scores. Furthermore, the results confirmed that the proposed linguistic features-syntactic complexity, quantitative complexity, and fluency-offer benefits that complement neural automated writing evaluation.
AB - Although Korean language education is experiencing rapid growth in recent years and several studies have investigated automated writing evaluation (AWE) systems, AWE for Korean L2 writing still remains unexplored. Therefore, this study aims to develop and validate a state-of-The-Art neural model AWE system which can be widely used for Korean language teaching and learning. Based on a Korean learner corpus, the proposed AWE is developed using natural language processing techniques such as part-of-speech tagging, syntactic parsing, and statistical language modeling to engineer linguistic features and a pre-Trained neural language model. This study attempted to determine how neural network models use different linguistic features to improve AWE performance. Experimental results of the proposed AWE tool showed that the neural AWE system achieves high reliability for unseen test data from the corpus, which implies metrics used in the AWE system can help differentiate different proficiency levels and predict holistic scores. Furthermore, the results confirmed that the proposed linguistic features-syntactic complexity, quantitative complexity, and fluency-offer benefits that complement neural automated writing evaluation.
UR - http://www.scopus.com/inward/record.url?scp=85149315041&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85149315041&partnerID=8YFLogxK
U2 - 10.1017/S1351324922000298
DO - 10.1017/S1351324922000298
M3 - Article
AN - SCOPUS:85149315041
SN - 1351-3249
VL - 29
SP - 1341
EP - 1363
JO - Natural Language Engineering
JF - Natural Language Engineering
IS - 5
ER -