Volume 1, Issue 2 November 2018, pp. 45–58
The impact of spelling errors on trained raters' scoring decisions
Second language (L2) writing assessments seldom allow a spellchecker and often have a time limit. Naturally, test takers often submit responses with spelling errors. However, little is known about whether and how spelling errors in test taker responses affect trained raters' scoring decisions. In this study, we investigated the impact of spelling errors on trained raters' holistic evaluation of response quality. We selected 148 responses to four L2 writing tasks, and created error-free versions of the responses by correcting spelling errors in the original responses. Both the original and corrected responses were randomly assigned to trained raters, who scored the responses according to the same holistic scoring rubrics. We compared the resulting scores of original and corrected responses to gauge the impact of spelling errors. We also examined whether the impact of spelling errors varied across different task types and spelling error characteristics. The results showed that the spelling error correction led to an average of more than a half score point increase. The score gains from the error correction varied across task types and the quantity of corrected errors. These findings have multiple implications, including suggestions for rater training and assessment development.
© Ikkyu Choi, Yeonsuk Cho
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Choi, I., & Cho, Y. (2018). The impact of spelling errors on trained raters' scoring decisions. Language Education & Assessment, 1(2), 45–58. https://doi.org/10.29140/lea.v1n2.61
Negotiating intercultural spaces and teacher identity in an internationalised school in Shanghai
Intercultural Communication Education Published: 23 August, 2019, Volume 2(2), 59–70.
(Re)imagining a course in language and intercultural communication for the 21st century
Adriana Raquel Diaz, Paul J. Moore
Intercultural Communication Education Published: 29 December, 2018, Volume 1(3), 83–99.
Reframing and hospicing mobility in higher education: Challenges and possibilities
Adriana Raquel Diaz, Marisa Cordella, Samantha Dispray, Barbara E. Hanna, Anna Mikhaylova
Intercultural Communication Education Published: 19 April, 2021, Volume 4(1), 106–121.
Strategy use, self-efficacy beliefs, and self-regulatedness in adult foreign language learning
Australian Journal of Applied Linguistics Published: 26 August, 2020, Volume 3(2), 152–167.
Engagement with technology: Gaming, immersion and sub-optimal experiences
Alastair Henry, Cecilia Thorsen
Technology in Language Teaching & Learning Published: 21 December, 2019, Volume 1(2), 52–67.
In pursuit of intercultural competence: Exploring self-awareness of EFL pupils in a lower-secondary school in Norway
Intercultural Communication Education Published: 23 December, 2020, Volume 3(3), 118–140.
Language, diversity and culturally responsive education
Ann E. Lopez
Migration and Language Education Published: 30 April, 2020, Volume 1(1), 3–13.
L2 motivation in ESP and EGP courses: An investigation of L2 motivational selves among learners of English in Saudi Arabia
Aser Nazzal K. Altalib
Australian Journal of Applied Linguistics Published: 30 April, 2019, Volume 2(1), 1–16.