A critical thinking-oriented approach in English as a foreign language (EFL) writing: Using ChatGPT as an ideal peer

Abstract

The present research reports on the effects of an AI-assisted critical thinking-oriented writing intervention supported with ChatGPT in EFL writing. AI-assisted Brainstorming Worksheets and AI-assisted Peer-review Checklists were provided to scaffold the writing process. This study employs a mixed-method approach, including pre- and post-tests with argumentative writing assessments and semi-structured interviews, involving 60 Chinese EFL learners at the CEFR intermediate (B1 to B2) level. Before the study, a pre-test was conducted to write an IELTS argumentative essay with a non-AI-supported CT-oriented approach scaffolded by peers. A post-test using an AI-assisted CT-oriented process scaffolded by ChatGPT (a virtual peer) was conducted immediately after the one-semester intervention. As a means of mitigating bias, two lecturers independently assessed the pre- and post-writing samples. Regarding data analysis, a t-test was employed to assess the variations in the participants' writing proficiency. The writing tests were measured in nine aspects in terms of a subject-specific thinking perspective, i.e., clarity, accuracy, precision, relevance, depth, breadth, logic, significance, and fairness. In addition, six qualitative interviews were conducted after the intervention to explore the benefits and drawbacks of implementing ChatGPT in CT-oriented writing compared to the conventional approach. For quantitative results, the intervention saw significant improvements in the students’ critical thinking reflected in writing. For qualitative results, how ChatGPT affected EFL learners’ CT-oriented writing was reported in five main aspects: in-depth CT concept understanding, model discourse with CT elements, information and feedback, logic, and Ai interaction. This study demonstrates how ChatGPT can be applied to scaffold CT-oriented writing training for EFL learners. The findings also offer insights into further research and development in AI tools for EFL writing practices.