Volume 5, Issue 1 December 2022, pp. 1–17 Download PDF

Regular Articles

Image-text relations and interjections in animated language-learning materials

Shin-ying Huang1

1 National Taiwan University, TAIWAN syhg@ntu.edu.tw

DOI: https://doi.org/10.29140/lea.v4n1.685


Abstract

This study examined image-text relations in English-as-a-foreign-language textbooks focusing on moving-image animations that accompany verbal dialogues. It also explores how animations support verbal dialogues in the textbooks. Data sources include three major versions of junior high school textbooks locally-produced in Taiwan, each consisting of 6 books, one for each semester. Findings show that animations enter into one specific type of image-text relations with the textual dialogue, i.e., a relation of Complementarity: Augmentation, by providing information that is consistent with and additional to the dialogues in a number of ways. The animations provide the rationale for a particular part of the dialogue not otherwise apparent, they portray another participant in the dialogue in addition to the speaker of the conversation turn, and they reveal a speaker’s emotional response that is not expressed verbally in the dialogue. In naturally-occurring conversations, these emotions would usually be expressed through interjections, but are mostly absent from the verbal dialogues in these textbooks. As such, the animations also serve to substitute the pragmatic markers that should have been present in the verbal text. Based on these findings, the article concludes by providing pedagogical recommendations for how animations could be used to guide language learners in exploring the possible communicative functions of appropriate interjections in the textbook dialogues in order to develop learners’ pragmatic competence.



Copyright

© Shin-ying Huang

CC  4.0
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.


Suggested citation

Huang, S.-Y. (2022). Image-text relations and interjections in animated language-learning materials. Language Education and Assessment, 5(1), 1–17. https://doi.org/10.29140/lea.v4n1.685


Author biodata

Shin-ying Huang is a professor in the Department of Foreign Languages and Literatures at National Taiwan University. Her research interests include critical literacies, multimodal literacies, discourse analysis, and conversation analysis.


Related Articles:

Intercultural education in times of restricted travel: Lessons from the Gaza Strip
Maria Grazia Imperiale
Intercultural Communication Education Published: 19 April, 2021, Volume 4(1), 22–38. Download PDF


"I don't want to be stereotypical, but..." Norwegian EFL learners' awareness of and willingness to challenge visual stereotypes
Cecilie Waallann Brown
Intercultural Communication Education Published: 20 December, 2019, Volume 2(3), 120–141. Download PDF


"Writing like a health scientist": A translingual approach to teaching text structure in a diverse Australian classroom
Sue Ollerhead, Isobel Crealy, Rebecca Kirk
Australian Journal of Applied Linguistics Published: 30 April, 2020, Volume 3(1), 77–90. Download PDF


(Mis)use of e-mail in student-faculty interaction: Implications for university instruction in Germany, Saudi Arabia and Japan
Anna Danielewicz-Betz
The JALT CALL Journal Published: 30 April, 2013, Volume 9(1), 23–57. Download PDF


(Re)imagining a course in language and intercultural communication for the 21st century
Adriana Raquel Díaz, Paul J. Moore
Intercultural Communication Education Published: 29 December, 2018, Volume 1(3), 83–99. Download PDF


(Re)turning to contrastive rhetoric’s basic communication principles: A Common Ground theory perspective
Jonathan D. Brown
Australian Journal of Applied Linguistics Published: 22 August, 2022, Volume 5(2), 77–87. Download PDF


3D digital games, virtual worlds, and language learning in higher education: Continuing challenges in Japan
Robert Swier, Mark Peterson
The JALT CALL Journal Published: 31 December, 2018, Volume 14(3), 225–238. Download PDF


A Case for the Drupal Content Management System
Paul Collett
The JALT CALL Journal Published: 30 April, 2010, Volume 6(1), 57–66. Download PDF


A case study of using Facebook in an EFL English writing class: The perspective of a writing teacher
Li-Tang Yu
The JALT CALL Journal Published: 31 December, 2014, Volume 10(3), 189–202. Download PDF


A comparative analysis of face to face instruction vs. Telegram mobile instruction in terms of narrative writing
Jamshid Heidari, Farzaneh Khodabandeh, Hassan Soleimani
The JALT CALL Journal Published: 31 August, 2018, Volume 14(2), 143–156. Download PDF