October 31, 2025 to November 2, 2025
National Olympics Memorial Youth Center / 国立オリンピック記念青少年総合センター
Asia/Tokyo timezone

Instrument Validation Project on EIKEN 2nd Grade Listening

Nov 1, 2025, 5:00 PM
20m
National Olympics Memorial Youth Center / 国立オリンピック記念青少年総合センター

National Olympics Memorial Youth Center / 国立オリンピック記念青少年総合センター

3-1 Yoyogikamizonocho, Shibuya, Tokyo 151-0052 / 〒151-0052 東京都渋谷区代々木神園町3-1

Speaker

伊勢 将人 (Temple University)

Description

In this study I evaluated the validity of the EIKEN 2nd grade listening test as a CEFR B1-level assessment. Rasch analysis showed moderate reliability and adequate item targeting for the sample, but revealed that the test content, vocabulary, and grammatical complexity are closer to A2 than B1, with limited contextual and accent variety. The variance explained by the model was low, indicating construct underrepresentation. Educationally, the findings suggest EIKEN 2nd grade might not accurately reflect B1 listening proficiency, highlighting the need for more authentic, challenging, and diverse test items to better inform teaching and assessment practices.

Summary

In this study I evaluated the validity of the EIKEN 2nd grade listening test as a CEFR B1-level assessment. Rasch analysis showed moderate reliability and adequate item targeting for the sample, but revealed that the test content, vocabulary, and grammatical complexity are closer to A2 than B1, with limited contextual and accent variety. The variance explained by the model was low, indicating construct underrepresentation. Educationally, the findings suggest EIKEN 2nd grade might not accurately reflect

Teaching Context Junior/senior high-school

Author

David Beglar (Temple University, Japan Campus)

Presentation materials