Volume 3, Issue 1 April 2020, pp. 13–35 
Regular Articles
Assessing L2 listening at a Japanese university: Effects of input type and response format
Kerry Pusey 
1
1 Nagasaki University, JAPAN 
DOI: https://doi.org/10.29140/lea.v3n1.193
Abstract
Large-scale and classroom-based tests of L2 listening comprehension typically employ audio-only listening texts and a multiple-choice response format. However, the effect of these test task characteristics on test-taker performance remains elusive, and begs the question as to whether they are the best option in terms of construct validity. Furthermore, the interaction between these test task characteristics and their potential joint effect on performance has not been sufficiently explored. To address this gap, a study was conducted at a Japanese university which investigated the effect of input type (audio-only vs. video) and response format (multiple-choice vs. short answer) on L2 listening test performance. Participants were divided into four groups to take an academic listening test with one of four combinations of input and response format: (1) audio-only with multiple-choice questions; (2) video with multiple-choice questions; (3) audio-only with short answer questions; and (4) video with short answer questions. Results of a 2 x 2 factorial ANOVA revealed a statistically significant effect of response format on test-taker performance. No significant effect for input type was found and no significant interaction among the variables was detected. Results suggest that visual input and audiovisual literacy need to be more clearly articulated within the construct definition of academic listening, if they are to be included at all.
Copyright
© Kerry Pusey
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Suggested citation
Pusey, K. (2020). Assessing L2 listening at a Japanese university: Effects of input type and response format. Language Education and Assessment, 3(1), 13–35. https://doi.org/10.29140/lea.v3n1.193
Related Articles:
Beginning again
Glenn Stockwell
Australian Journal of Applied Linguistics Published: 1 April, 2018, Volume 1(1), 1–2. 
Insights from replication on the factors affecting task engagement in mobile-based learning activities
Glenn Stockwell
Technology in Language Teaching and Learning Published: 28 June, 2019, Volume 1(1), 33–51.
Syntactical and lexical development in NNS-NNS Asynchronous CMC
Glenn Stockwell
The JALT CALL Journal Published: 31 December, 2005, Volume 1(3), 33–49.
Investigating an intelligent system for vocabulary learning through reading
Glenn Stockwell
The JALT CALL Journal Published: 31 December, 2013, Volume 9(3), 259–274.
Review of Developing writing skills for IELTS: A research-based approach
Hassan Mohebbi
Australian Journal of Applied Linguistics Published: 28 April, 2021, Volume 4(1), 34–36.
Making global knowledge accessible to EFL speakers of an undergraduate leadership program through a flipped and ubiquitous learning environment
Nobue Tanaka-Ellis, Sachiyo Sekiguchi
Technology in Language Teaching and Learning Published: 28 June, 2019, Volume 1(1), 3–20.
Encouraging autonomy through the use of a social networking system
Adrian Leis
The JALT CALL Journal Published: 30 April, 2014, Volume 10(1), 69–80.
Exploring EFL teachers’ professional identity development in a CALL teacher preparation program
Hussein Meihami, Rajab Esfandiari
The JALT CALL Journal Published: 25 August, 2021, Volume 17(2), 135–157.
(Re)imagining a course in language and intercultural communication for the 21st century
Adriana Raquel Díaz, Paul J. Moore
Intercultural Communication Education Published: 29 December, 2018, Volume 1(3), 83–99.
Reframing and hospicing mobility in higher education: Challenges and possibilities
Adriana Raquel Díaz, Marisa Cordella, Samantha Dispray, Barbara E. Hanna, Anna Mikhaylova
Intercultural Communication Education Published: 19 April, 2021, Volume 4(1), 106–121.