RSS
Follow by Email
Facebook
Twitter
LinkedIn


Volume 1, Issue 2  November 2018, pp. 45-58          Download PDF

Articles
The impact of spelling errors on trained raters' scoring decisions

Ikkyu Choi https://orcid.org/0000-0002-8281-72111, Yeonsuk Cho https://orcid.org/0000-0002-4997-61062

1 Educational Testing Service, USA ichoi001@ets.org
2 Educational Testing Service, USA ycho@ets.org

DOI: https://doi.org/10.29140/lea.v1n2.61


Abstract

Second language (L2) writing assessments seldom allow a spellchecker and often have a time limit. Naturally, test takers often submit responses with spelling errors. However, little is known about whether and how spelling errors in test taker responses affect trained raters' scoring decisions. In this study, we investigated the impact of spelling errors on trained raters' holistic evaluation of response quality. We selected 148 responses to four L2 writing tasks, and created error-free versions of the responses by correcting spelling errors in the original responses. Both the original and corrected responses were randomly assigned to trained raters, who scored the responses according to the same holistic scoring rubrics. We compared the resulting scores of original and corrected responses to gauge the impact of spelling errors. We also examined whether the impact of spelling errors varied across different task types and spelling error characteristics. The results showed that the spelling error correction led to an average of more than a half score point increase. The score gains from the error correction varied across task types and the quantity of corrected errors. These findings have multiple implications, including suggestions for rater training and assessment development.



Copyright

© Ikkyu Choi, Yeonsuk Cho

CC BY-NC 4.0
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.


Suggested citation

Ikkyu Choi, Yeonsuk Cho. (2018). The impact of spelling errors on trained raters' scoring decisions. Language Education & Assessment, 1(2), 45-58. https://doi.org/10.29140/lea.v1n2.61


Related Articles:

"I don't want to be stereotypical, but..." Norwegian EFL learners' awareness of and willingness to challenge visual stereotypes
Cecilie Waallann Brown
Intercultural Communication Education Published: 20 December, 2019, Volume 2(3), pp. 120-141. Download PDF

"Writing like a health scientist": A translingual approach to teaching text structure in a diverse Australian classroom
Sue Ollerhead, Isobel Crealy, Rebecca Kirk
Australian Journal of Applied Linguistics Published: 30 April, 2020, Volume 3(1), pp. 77-90. Download PDF

(Re)imagining a course in language and intercultural communication for the 21st century
Adriana Raquel Diaz, Paul J. Moore
Intercultural Communication Education Published: 29 December, 2018, Volume 1(3), pp. 83-99. Download PDF

A day in the life: Mapping international students' language learning environments in multilingual Sydney
Phil Benson, Philip Chappell, Lynda Yates
Australian Journal of Applied Linguistics Published: 1 April, 2018, Volume 1(1), pp. 20-32. Download PDF

A developmental framework for online language teaching skills
Ursula Stickler, Regine Hampel, Martina Emke
Australian Journal of Applied Linguistics Published: 30 April, 2020, Volume 3(1), pp. 133-151. Download PDF

A systematic review of written corrective feedback research in ESL/EFL contexts
Sin Wang Chong
Language Education & Assessment Published: 31 August, 2019, Volume 2(2), pp. 57-69. Download PDF

Adopting a dual focus to drive forward the fields of language education and language assessment
Heng-Tsung Danny Huang
Language Education & Assessment Published: 25 July, 2018, Volume 1(1), pp. 1-2. Download PDF

Advancing intercultural learning in world language education: Recent developments in pre-service teacher education in the U.S.
Paula Garrett-Rucks
Intercultural Communication Education Published: 29 December, 2018, Volume 1(3), pp. 110-122. Download PDF

An essay on internationalism in foreign language education
Michael Byram
Intercultural Communication Education Published: 22 August, 2018, Volume 1(2), pp. 64-82. Download PDF

An investigation of implicit vs. explicit oral corrective feedback on Chinese pupils' use of past tense
Qin Xie, Chingyee Yeung
Language Education & Assessment Published: 29 November, 2018, Volume 1(2), pp. 59-75. Download PDF