Examining the Effect of Automated Assessments and Feedback on Students' Written Science Explanations

Sadhana Puntambekar; Indrani Dey; Dana Gnesdilow; Rebecca J. Passonneau; Chan Min Kim

Examining the Effect of Automated Assessments and Feedback on Students' Written Science Explanations

Sadhana Puntambekar
, Indrani Dey
, Dana Gnesdilow
, Rebecca J. Passonneau
, Chan Min Kim

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Writing scientific explanations is a core practice in science. However, students find it difficult to write coherent scientific explanations. Additionally, teachers find it challenging to provide real-time feedback on students' essays. In this study, we discuss how PyrEval, an NLP technology, was used to automatically assess students' essays and provide feedback. We found that students explained more key ideas in their essays after the automated assessment and feedback. However, there were issues with the automated assessments as well as students' understanding of the feedback and revising their essays.

Original language	English (US)
Title of host publication	ISLS Annual Meeting 2023
Subtitle of host publication	Building Knowledge and Sustaining our Community - 17th International Conference of the Learning Sciences, ICLS 2023, Proceedings
Editors	Paulo Blikstein, Jan Van Aalst, Rita Kizito, Karen Brennan
Publisher	International Society of the Learning Sciences (ISLS)
Pages	1865-1866
Number of pages	2
ISBN (Electronic)	9781737330677
State	Published - 2023
Event	17th International Conference of the Learning Sciences, ICLS 2023 - Montreal, Canada Duration: Jun 10 2023 → Jun 15 2023

Publication series

Name	Proceedings of International Conference of the Learning Sciences, ICLS
ISSN (Print)	1814-9316

Conference

Conference	17th International Conference of the Learning Sciences, ICLS 2023
Country/Territory	Canada
City	Montreal
Period	6/10/23 → 6/15/23

All Science Journal Classification (ASJC) codes

Computer Science (miscellaneous)
Education

Cite this

Puntambekar, S., Dey, I., Gnesdilow, D., Passonneau, R. J., & Kim, C. M. (2023). Examining the Effect of Automated Assessments and Feedback on Students' Written Science Explanations. In P. Blikstein, J. Van Aalst, R. Kizito, & K. Brennan (Eds.), ISLS Annual Meeting 2023: Building Knowledge and Sustaining our Community - 17th International Conference of the Learning Sciences, ICLS 2023, Proceedings (pp. 1865-1866). (Proceedings of International Conference of the Learning Sciences, ICLS). International Society of the Learning Sciences (ISLS).

Puntambekar, Sadhana ; Dey, Indrani ; Gnesdilow, Dana et al. / Examining the Effect of Automated Assessments and Feedback on Students' Written Science Explanations. ISLS Annual Meeting 2023: Building Knowledge and Sustaining our Community - 17th International Conference of the Learning Sciences, ICLS 2023, Proceedings. editor / Paulo Blikstein ; Jan Van Aalst ; Rita Kizito ; Karen Brennan. International Society of the Learning Sciences (ISLS), 2023. pp. 1865-1866 (Proceedings of International Conference of the Learning Sciences, ICLS).

@inproceedings{2362167a7e5d46108ebe85b818b4414b,

title = "Examining the Effect of Automated Assessments and Feedback on Students' Written Science Explanations",

abstract = "Writing scientific explanations is a core practice in science. However, students find it difficult to write coherent scientific explanations. Additionally, teachers find it challenging to provide real-time feedback on students' essays. In this study, we discuss how PyrEval, an NLP technology, was used to automatically assess students' essays and provide feedback. We found that students explained more key ideas in their essays after the automated assessment and feedback. However, there were issues with the automated assessments as well as students' understanding of the feedback and revising their essays.",

author = "Sadhana Puntambekar and Indrani Dey and Dana Gnesdilow and Passonneau, \{Rebecca J.\} and Kim, \{Chan Min\}",

note = "Publisher Copyright: {\textcopyright} ISLS.; 17th International Conference of the Learning Sciences, ICLS 2023 ; Conference date: 10-06-2023 Through 15-06-2023",

year = "2023",

language = "English (US)",

series = "Proceedings of International Conference of the Learning Sciences, ICLS",

publisher = "International Society of the Learning Sciences (ISLS)",

pages = "1865--1866",

editor = "Paulo Blikstein and \{Van Aalst\}, Jan and Rita Kizito and Karen Brennan",

booktitle = "ISLS Annual Meeting 2023",

}

Puntambekar, S, Dey, I, Gnesdilow, D, Passonneau, RJ & Kim, CM 2023, Examining the Effect of Automated Assessments and Feedback on Students' Written Science Explanations. in P Blikstein, J Van Aalst, R Kizito & K Brennan (eds), ISLS Annual Meeting 2023: Building Knowledge and Sustaining our Community - 17th International Conference of the Learning Sciences, ICLS 2023, Proceedings. Proceedings of International Conference of the Learning Sciences, ICLS, International Society of the Learning Sciences (ISLS), pp. 1865-1866, 17th International Conference of the Learning Sciences, ICLS 2023, Montreal, Canada, 6/10/23.

Examining the Effect of Automated Assessments and Feedback on Students' Written Science Explanations. / Puntambekar, Sadhana; Dey, Indrani; Gnesdilow, Dana et al.
ISLS Annual Meeting 2023: Building Knowledge and Sustaining our Community - 17th International Conference of the Learning Sciences, ICLS 2023, Proceedings. ed. / Paulo Blikstein; Jan Van Aalst; Rita Kizito; Karen Brennan. International Society of the Learning Sciences (ISLS), 2023. p. 1865-1866 (Proceedings of International Conference of the Learning Sciences, ICLS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Examining the Effect of Automated Assessments and Feedback on Students' Written Science Explanations

AU - Puntambekar, Sadhana

AU - Dey, Indrani

AU - Gnesdilow, Dana

AU - Passonneau, Rebecca J.

AU - Kim, Chan Min

N1 - Publisher Copyright: © ISLS.

PY - 2023

Y1 - 2023

N2 - Writing scientific explanations is a core practice in science. However, students find it difficult to write coherent scientific explanations. Additionally, teachers find it challenging to provide real-time feedback on students' essays. In this study, we discuss how PyrEval, an NLP technology, was used to automatically assess students' essays and provide feedback. We found that students explained more key ideas in their essays after the automated assessment and feedback. However, there were issues with the automated assessments as well as students' understanding of the feedback and revising their essays.

AB - Writing scientific explanations is a core practice in science. However, students find it difficult to write coherent scientific explanations. Additionally, teachers find it challenging to provide real-time feedback on students' essays. In this study, we discuss how PyrEval, an NLP technology, was used to automatically assess students' essays and provide feedback. We found that students explained more key ideas in their essays after the automated assessment and feedback. However, there were issues with the automated assessments as well as students' understanding of the feedback and revising their essays.

UR - https://www.scopus.com/pages/publications/105005961135

UR - https://www.scopus.com/pages/publications/105005961135#tab=citedBy

M3 - Conference contribution

AN - SCOPUS:105005961135

T3 - Proceedings of International Conference of the Learning Sciences, ICLS

SP - 1865

EP - 1866

BT - ISLS Annual Meeting 2023

A2 - Blikstein, Paulo

A2 - Van Aalst, Jan

A2 - Kizito, Rita

A2 - Brennan, Karen

PB - International Society of the Learning Sciences (ISLS)

T2 - 17th International Conference of the Learning Sciences, ICLS 2023

Y2 - 10 June 2023 through 15 June 2023

ER -

Puntambekar S, Dey I, Gnesdilow D, Passonneau RJ , Kim CM. Examining the Effect of Automated Assessments and Feedback on Students' Written Science Explanations. In Blikstein P, Van Aalst J, Kizito R, Brennan K, editors, ISLS Annual Meeting 2023: Building Knowledge and Sustaining our Community - 17th International Conference of the Learning Sciences, ICLS 2023, Proceedings. International Society of the Learning Sciences (ISLS). 2023. p. 1865-1866. (Proceedings of International Conference of the Learning Sciences, ICLS).

Examining the Effect of Automated Assessments and Feedback on Students' Written Science Explanations

Abstract

Publication series

Conference

All Science Journal Classification (ASJC) codes

Other files and links

Fingerprint

Cite this