Volume 2, Issue 3 December 2019, pp. 110–134 
Articles
The effect of cohesive features in integrated and independent L2 writing quality and text classification
Rurik Tywoniw 
1, & Scott Crossley 2
1 Georgia State University, USA 
2 Georgia State University, USA
DOI: https://doi.org/10.29140/lea.v2n3.151
Abstract
Cohesion features were calculated for a corpus of 960 essays by 480 test-takers from the Test of English as a Foreign Language (TOEFL) in order to examine differences in the use of cohesion devices between integrated (source-based) writing and independent writing samples. Cohesion indices were measured using an automated textual analysis tool, the Tool for the Automatic Assessment of Cohesion (TAACO). A discriminant function analysis correctly classified essays as either integrated or independent in 92.3 per cent of cases. Integrated writing was marked by higher use of specific connectives and greater lexical overlap of content words between textual units, whereas independent writing was marked by greater lexical overlap of function words, especially pronouns. Regression analyses found that cohesive indices which distinguish tasks predict writing quality judgments more strongly in independent writing. However, the strongest predictor of human judgments was the same for both tasks: lexical overlap of function words. The findings demonstrate that text cohesion is a multidimensional construct shaped by the writing task, yet the measures of cohesion which affect human judgments of writing quality are not entirely different across tasks. These analyses allow us to better understand cohesive features in writing tasks and implications for automated writing assessment.
Copyright
© Rurik Tywoniw, Scott Crossley
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Suggested citation
Tywoniw, R., & Crossley, S. (2019). The effect of cohesive features in integrated and independent L2 writing quality and text classification. Language Education and Assessment, 2(3), 110–134. https://doi.org/10.29140/lea.v2n3.151
Related Articles:
Incorporating hypnotic suggestion into teacher education programs
Farshad Ghasemi
Australian Journal of Applied Linguistics Published: 31 December, 2019, Volume 2(3), 83–103. 
What makes students speak Japanese in immersion programs?
Kumiko Katayama, Kayoko Hashimoto
Australian Journal of Applied Linguistics Published: 31 December, 2019, Volume 2(3), 104–120.
Voicing the academy
Davina Allison
Australian Journal of Applied Linguistics Published: 31 December, 2018, Volume 1(3), 102–117.
Theory of Mind development and narrative writing: A longitudinal study
Birgitta E. Svensson
Australian Journal of Applied Linguistics Published: 31 December, 2018, Volume 1(3), 118–134.
Incidental vocabulary learning through watching movies
Robert J. Ashcroft, Joseph Garner, Oliver Hadingham
Australian Journal of Applied Linguistics Published: 31 December, 2018, Volume 1(3), 135–147.
The Council of Europe Reference Framework of Competences for Democratic Culture:
Ideological refractions, othering and obedient politics
Ashley Simpson, Fred Dervin
Intercultural Communication Education Published: 20 December, 2019, Volume 2(3), 102–119.
"I don't want to be stereotypical, but..."
Norwegian EFL learners' awareness of and willingness to challenge visual stereotypes
Cecilie Waallann Brown
Intercultural Communication Education Published: 20 December, 2019, Volume 2(3), 120–141.
(Re)imagining a course in language and intercultural communication for the 21st century
Adriana Raquel Díaz, Paul J. Moore
Intercultural Communication Education Published: 29 December, 2018, Volume 1(3), 83–99.
Critical intercultural communication education: cultural analysis and pedagogical applications
Sofia A. Koutlaki, Zohreh R. Eslami
Intercultural Communication Education Published: 29 December, 2018, Volume 1(3), 100–109.
Advancing intercultural learning in world language education: Recent developments in pre-service teacher education in the U.S.
Paula Garrett-Rucks
Intercultural Communication Education Published: 29 December, 2018, Volume 1(3), 110–122.