Sense-aware connective-based indices of cohesion and their relationship to cohesion ratings of English language learners' written production

The use of connectives has been considered important for assessing the cohesion of written texts (Crossley et al., 2019). However, existing connective-based indices have not systematically addressed two issues of ambiguity, namely, that between discourse and non-discourse use of polysemous word forms and that in terms of the specific discourse relations marked by polysemous discourse connectives (Pitler & Nenkova, 2009). This study proposes 34 sense-aware connective-based indices of cohesion that account for these issues and assesses their predictive power for cohesion ratings in comparison to 25 existing indices. Results from the analysis of 3,911 argumentative essays from the English Language Learner Insight, Proficiency and Skills Evaluation Corpus show that 23 sense-aware indices but only three existing indices correlated significantly and meaningfully with cohesion ratings. The sense-aware indices also exhibited greater predictive power for cohesion ratings than existing indices. The implications of our findings for future cohesion research are discussed.