Volume 3, Issue 1  April 2020, pp. 13–35          Download PDF

Regular Articles
Assessing L2 listening at a Japanese university: Effects of input type and response format

Kerry Pusey https://orcid.org/0000-0001-7178-06201

1 Nagasaki University, Japan kerryjpusey@gmail.com

DOI: https://doi.org/10.29140/lea.v3n1.193


Abstract

Large-scale and classroom-based tests of L2 listening comprehension typically employ audio-only listening texts and a multiple-choice response format. However, the effect of these test task characteristics on test-taker performance remains elusive, and begs the question as to whether they are the best option in terms of construct validity. Furthermore, the interaction between these test task characteristics and their potential joint effect on performance has not been sufficiently explored. To address this gap, a study was conducted at a Japanese university which investigated the effect of input type (audio-only vs. video) and response format (multiple-choice vs. short answer) on L2 listening test performance. Participants were divided into four groups to take an academic listening test with one of four combinations of input and response format: (1) audio-only with multiple-choice questions; (2) video with multiple-choice questions; (3) audio-only with short answer questions; and (4) video with short answer questions. Results of a 2 x 2 factorial ANOVA revealed a statistically significant effect of response format on test-taker performance. No significant effect for input type was found and no significant interaction among the variables was detected. Results suggest that visual input and audiovisual literacy need to be more clearly articulated within the construct definition of academic listening, if they are to be included at all.



Copyright

© Kerry Pusey

CC  4.0
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.


Suggested citation

Pusey, K. (2020). Assessing L2 listening at a Japanese university: Effects of input type and response format. Language Education & Assessment, 3(1), 13–35. https://doi.org/10.29140/lea.v3n1.193


Related Articles:

EFL learners' peer negotiations and attitudes in mobile-assisted collaborative writing
Shiou-Wen Yeh, Cheng-Ting Chen
Language Education & Assessment Published: 30 April, 2019, Volume 2(1), 41–56. Download PDF

Interculturality as collaborative identity management in language education
Claudia Borghetti
Intercultural Communication Education Published: 30 April, 2019, Volume 2(1), 20–38. Download PDF

Washback of ACTFL's Integrated Performance Assessment in an intensive summer language program at the tertiary level
Jason Martel
Language Education & Assessment Published: 31 August, 2019, Volume 2(2), 57–69. Download PDF

Critical intercultural communication education: cultural analysis and pedagogical applications
Sofia A. Koutlaki, Zohreh R. Eslami
Intercultural Communication Education Published: 29 December, 2018, Volume 1(3), 100–109. Download PDF

L2 motivation in ESP and EGP courses: An investigation of L2 motivational selves among learners of English in Saudi Arabia
Aser Nazzal K. Altalib
Australian Journal of Applied Linguistics Published: 30 April, 2019, Volume 2(1), 1–16. Download PDF

Advancing intercultural learning in world language education: Recent developments in pre-service teacher education in the U.S.
Paula Garrett-Rucks
Intercultural Communication Education Published: 29 December, 2018, Volume 1(3), 110–122. Download PDF

An investigation of learners' use of CAN and COULD
Lauren Whitty
Australian Journal of Applied Linguistics Published: 30 April, 2019, Volume 2(1), 32–46. Download PDF

Integrating multimodal technologies with VARK strategies for learning and teaching EFL presentation: An investigation into learners' achievements and perceptions of the learning process
Yow-jyy Joyce Lee
Australian Journal of Applied Linguistics Published: 30 April, 2019, Volume 2(1), 17–31. Download PDF

Teaching pragmatics: Nonnative-speaker teachers' knowledge, beliefs and reported practices
Christine Savvidou, Maria Economidou-Kogetsidis
Intercultural Communication Education Published: 30 April, 2019, Volume 2(1), 39–58. Download PDF

Factors affecting immigrants' host country language proficiency: Focusing on the differences between migrant workers and marriage-migrant women in South Korea
In Young Yang, Seongseog Park, Sungjun Lee, Byeonggon Min
Migration and Language Education Published: 30 April, 2020, Volume 1(1), 14–30. Download PDF