JALT2025 - Tokyo

Validating a Listening Test: A Cautionary Tale

Nov 2, 2025, 1:10 PM

30m

National Olympics Memorial Youth Center / 国立オリンピック記念青少年総合センター

Research-oriented Presentation (30-minutes) Materials and Assessment Room 509

Speakers

Dr Peter Parise (Kanagawa Prefectural Integrated Education Center and Wayo Women's University) Robert Edick

Description

This presentation will show the process of validating a pre-/post-test for an intensive listening study. The test is a modified TOEIC Listening Test, which was created from two valid sources and shortened in length. The participants are 37 first-year students at a women's university. The data was analyzed via Rasch analysis, and correlations with the standard scores from the listening section of TOEIC were used to verify the validity of this instrument.

Summary

This presentation will show the process of validating a pre/post-test for an intensive listening study. The test is a modified TOEIC Listening Test, which was created from two valid sources and shortened in length. The participants are 37 first-year students at a women's university. The data was analyzed via Rasch analysis, and correlations with the standard scores from the listening section of TOEIC were used to verify the validity of this instrument.