Volume 2, Issue 3 December 2019, pp. 110–134

Articles
The effect of cohesive features in integrated and independent L2 writing quality and text classification

Rurik Tywoniw ¹, Scott Crossley ²

¹ Georgia State University, USA
² Georgia State University, USA

DOI: https://doi.org/10.29140/lea.v2n3.151

Abstract

Cohesion features were calculated for a corpus of 960 essays by 480 test-takers from the Test of English as a Foreign Language (TOEFL) in order to examine differences in the use of cohesion devices between integrated (source-based) writing and independent writing samples. Cohesion indices were measured using an automated textual analysis tool, the Tool for the Automatic Assessment of Cohesion (TAACO). A discriminant function analysis correctly classified essays as either integrated or independent in 92.3 per cent of cases. Integrated writing was marked by higher use of specific connectives and greater lexical overlap of content words between textual units, whereas independent writing was marked by greater lexical overlap of function words, especially pronouns. Regression analyses found that cohesive indices which distinguish tasks predict writing quality judgments more strongly in independent writing. However, the strongest predictor of human judgments was the same for both tasks: lexical overlap of function words. The findings demonstrate that text cohesion is a multidimensional construct shaped by the writing task, yet the measures of cohesion which affect human judgments of writing quality are not entirely different across tasks. These analyses allow us to better understand cohesive features in writing tasks and implications for automated writing assessment.

Copyright

© Rurik Tywoniw, Scott Crossley

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Suggested citation

Tywoniw, R., & Crossley, S. (2019). The effect of cohesive features in integrated and independent L2 writing quality and text classification. Language Education & Assessment, 2(3), 110–134. https://doi.org/10.29140/lea.v2n3.151

Related Articles:

TOEFL iBT Training in the CALL Classroom
Aaron P. Campbell, Richard Silver
The JALT CALL Journal Published: 31 August, 2011, Volume 7(2), 217–229.

EFL student and faculty perceptions of and attitudes towards online testing in the medium of Blackboard: Promises and challenges
Abdulaziz I. Fageeh
The JALT CALL Journal Published: 30 April, 2015, Volume 11(1), 41–62.

EFL students’ readiness for e-learning: Factors influencing e-learners’ acceptance of the Blackboard in a Saudi university
Abdulaziz Ibraheem Fageeh
The JALT CALL Journal Published: 30 April, 2011, Volume 7(1), 19–42.

Effects of Blackboard on EFL academic writing and attitudes
Abdulaziz Fageeh, Mohamed Amin A. Mekheimer
The JALT CALL Journal Published: 31 August, 2013, Volume 9(2), 169–196.

Touch the page and mimic me: Evaluation of a talking-pen learning tool
Abigail Odakura
The JALT CALL Journal Published: 31 December, 2013, Volume 9(3), 287–295.

A survey of Japanese university students' computer literacy skills
Adam Murray, Andrew Blyth
The JALT CALL Journal Published: 31 December, 2011, Volume 7(3), 307–318.

Negotiating intercultural spaces and teacher identity in an internationalised school in Shanghai
Adam Poole
Intercultural Communication Education Published: 23 August, 2019, Volume 2(2), 59–70.

Designing a course in intercultural education
Adrian Holliday
Intercultural Communication Education Published: 11 August, 2018, Volume 1(1), 4–11.

Encouraging autonomy through the use of a social networking system
Adrian Leis
The JALT CALL Journal Published: 30 April, 2014, Volume 10(1), 69–80.