October 31, 2025 to November 2, 2025
National Olympics Memorial Youth Center / 国立オリンピック記念青少年総合センター
Asia/Tokyo timezone

AI and Educators in Partnership: Transforming English Language Assessment with a Hybrid Model

Oct 31, 2025, 4:35 PM
30m
National Olympics Memorial Youth Center / 国立オリンピック記念青少年総合センター

National Olympics Memorial Youth Center / 国立オリンピック記念青少年総合センター

3-1 Yoyogikamizonocho, Shibuya, Tokyo 151-0052 / 〒151-0052 東京都渋谷区代々木神園町3-1
Research-oriented Presentation (30-minutes) Technology Room 404

Speaker

Hiroyuki Obari (Globiz Professional University)

Description

This research investigates a hybrid AI-human assessment model using Scribo and Progos to evaluate English proficiency at the tertiary level in Japan. Findings from a mixed-methods study (N = 41) reveal significant improvements in speaking and writing proficiency, with students advancing to the B2 level of the CEFR. While AI enhances learner autonomy and provides immediate feedback, the results highlight the need for human evaluation to assess cultural nuance and complex discourse, thereby ensuring a balanced and practical language assessment approach.

Summary

This presentation explores the integration of AI-powered tools, Scribo and Progos, in English language assessment at the tertiary level in Japan. The study demonstrates how AI-driven feedback enhances learner autonomy and proficiency while highlighting the necessity of human evaluation for higher-order skills. Participants will gain insights into implementing a hybrid AI-human assessment model to optimize learning outcomes, ensuring a balance between technological efficiency and pedagogical expertise in language education.

Teaching Context College and university education

Author

Hiroyuki Obari (Globiz Professional University)

Presentation materials