Volume 2, Issue 3 December 2019, pp. 110–134 Download PDF

Articles

The effect of cohesive features in integrated and independent L2 writing quality and text classification

Rurik Tywoniw https://orcid.org/0000-0003-2885-58711, & Scott Crossley https://orcid.org/0000-0002-5148-02732

1 Georgia State University, USA rtywoniw1@gsu.edu
2 Georgia State University, USA scrossley@gsu.edu

DOI: https://doi.org/10.29140/lea.v2n3.151


Abstract

Cohesion features were calculated for a corpus of 960 essays by 480 test-takers from the Test of English as a Foreign Language (TOEFL) in order to examine differences in the use of cohesion devices between integrated (source-based) writing and independent writing samples. Cohesion indices were measured using an automated textual analysis tool, the Tool for the Automatic Assessment of Cohesion (TAACO). A discriminant function analysis correctly classified essays as either integrated or independent in 92.3 per cent of cases. Integrated writing was marked by higher use of specific connectives and greater lexical overlap of content words between textual units, whereas independent writing was marked by greater lexical overlap of function words, especially pronouns. Regression analyses found that cohesive indices which distinguish tasks predict writing quality judgments more strongly in independent writing. However, the strongest predictor of human judgments was the same for both tasks: lexical overlap of function words. The findings demonstrate that text cohesion is a multidimensional construct shaped by the writing task, yet the measures of cohesion which affect human judgments of writing quality are not entirely different across tasks. These analyses allow us to better understand cohesive features in writing tasks and implications for automated writing assessment.



Copyright

© Rurik Tywoniw, Scott Crossley

CC  4.0
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.


Suggested citation

Tywoniw, R., & Crossley, S. (2019). The effect of cohesive features in integrated and independent L2 writing quality and text classification. Language Education and Assessment, 2(3), 110–134. https://doi.org/10.29140/lea.v2n3.151


Related Articles:

EFL learners’ peer negotiations and attitudes in mobile-assisted collaborative writing
Shiou-Wen Yeh, Cheng-Ting Chen
Language Education and Assessment Published: 30 April, 2019, Volume 2(1), 41–56. Download PDF


Interculturality as collaborative identity management in language education
Claudia Borghetti
Intercultural Communication Education Published: 30 April, 2019, Volume 2(1), 20–38. Download PDF


Washback of ACTFL's Integrated Performance Assessment in an intensive summer language program at the tertiary level
Jason Martel
Language Education and Assessment Published: 31 August, 2019, Volume 2(2), 57–69. Download PDF


Critical intercultural communication education: cultural analysis and pedagogical applications
Sofia A. Koutlaki, Zohreh R. Eslami
Intercultural Communication Education Published: 29 December, 2018, Volume 1(3), 100–109. Download PDF


L2 motivation in ESP and EGP courses: An investigation of L2 motivational selves among learners of English in Saudi Arabia
Aser Nazzal K. Altalib
Australian Journal of Applied Linguistics Published: 30 April, 2019, Volume 2(1), 1–16. Download PDF


Advancing intercultural learning in world language education: Recent developments in pre-service teacher education in the U.S.
Paula Garrett-Rucks
Intercultural Communication Education Published: 29 December, 2018, Volume 1(3), 110–122. Download PDF


An investigation of learners' use of CAN and COULD
Lauren Whitty
Australian Journal of Applied Linguistics Published: 30 April, 2019, Volume 2(1), 32–46. Download PDF


Integrating multimodal technologies with VARK strategies for learning and teaching EFL presentation: An investigation into learners' achievements and perceptions of the learning process
Yow-jyy Joyce Lee
Australian Journal of Applied Linguistics Published: 30 April, 2019, Volume 2(1), 17–31. Download PDF


Teaching pragmatics: Nonnative-speaker teachers' knowledge, beliefs and reported practices
Christine Savvidou, Maria Economidou-Kogetsidis
Intercultural Communication Education Published: 30 April, 2019, Volume 2(1), 39–58. Download PDF


Factors affecting immigrants' host country language proficiency: Focusing on the differences between migrant workers and marriage-migrant women in South Korea
In Young Yang, Seongseog Park, Sungjun Lee, Byeonggon Min
Migration and Language Education Published: 30 April, 2020, Volume 1(1), 14–30. Download PDF