Volume 2, Issue 3 December 2019, pp. 110-134
The effect of cohesive features in integrated and independent L2 writing quality and text classification
Cohesion features were calculated for a corpus of 960 essays by 480 test-takers from the Test of English as a Foreign Language (TOEFL) in order to examine differences in the use of cohesion devices between integrated (source-based) writing and independent writing samples. Cohesion indices were measured using an automated textual analysis tool, the Tool for the Automatic Assessment of Cohesion (TAACO). A discriminant function analysis correctly classified essays as either integrated or independent in 92.3 per cent of cases. Integrated writing was marked by higher use of specific connectives and greater lexical overlap of content words between textual units, whereas independent writing was marked by greater lexical overlap of function words, especially pronouns. Regression analyses found that cohesive indices which distinguish tasks predict writing quality judgments more strongly in independent writing. However, the strongest predictor of human judgments was the same for both tasks: lexical overlap of function words. The findings demonstrate that text cohesion is a multidimensional construct shaped by the writing task, yet the measures of cohesion which affect human judgments of writing quality are not entirely different across tasks. These analyses allow us to better understand cohesive features in writing tasks and implications for automated writing assessment.
© Rurik Tywoniw, Scott Crossley
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Rurik Tywoniw, Scott Crossley. (2019). The effect of cohesive features in integrated and independent L2 writing quality and text classification. Language Education & Assessment, 2(3), 110-134. https://doi.org/10.29140/lea.v2n3.151
Interpersonal meaning of code-switching: An analysis of three TV series
Australian Journal of Applied Linguistics Published: 1 April, 2018, Volume 1(1), pp. 3-19.
Revisiting the digital divide(s): Technology-enhanced English language practices at a university in Pakistan
Shaista Rashid, Una Cunningham, Kevin Watson, Jocelyn Howard
Australian Journal of Applied Linguistics Published: 31 August, 2018, Volume 1(2), pp. 64-87.
Examining learners' further investment in Japanese learning through study abroad experiences
Australian Journal of Applied Linguistics Published: 1 April, 2018, Volume 1(1), pp. 33-48.
A day in the life: Mapping international students' language learning environments in multilingual Sydney
Phil Benson, Philip Chappell, Lynda Yates
Australian Journal of Applied Linguistics Published: 1 April, 2018, Volume 1(1), pp. 20-32.
Interculturality in a different light: Modesty towards democracy in education?
Yongjian Li, Fred Dervin
Intercultural Communication Education Published: 11 April, 2018, Volume 1(1), pp. 12-26.
Revisiting communicative competence in the teaching and assessment of language for specific purposes
Language Education & Assessment Published: 30 April, 2019, Volume 2(1), pp. 1-19.
Language learning and activation in and beyond the classroom
Julie Choi, David Nunan
Australian Journal of Applied Linguistics Published: 31 August, 2018, Volume 1(2), pp. 49-63.
Then and now: Themes in language assessment research
Language Education & Assessment Published: 25 July, 2018, Volume 1(1), pp. 3-8.