31 October 2025 to 2 November 2025
National Olympics Memorial Youth Center / 国立オリンピック記念青少年総合センター
Asia/Tokyo timezone

Towards Valid L2 English Writing Assessment in the Age of Large Language Models

1 Nov 2025, 15:05
30m
National Olympics Memorial Youth Center / 国立オリンピック記念青少年総合センター

National Olympics Memorial Youth Center / 国立オリンピック記念青少年総合センター

3-1 Yoyogikamizonocho, Shibuya, Tokyo 151-0052 / 〒151-0052 東京都渋谷区代々木神園町3-1
Research-oriented Presentation (30-minutes) Technology Room 506

Speaker

Anthony Diaz (University of California, Davis)

Description

This presentation explores the use of generative language models by students in tertiary education contexts and how the use of text classification might be applied to detect LLM-generated writing. Using essays from L1 Japanese learners of English and Llama 2, three classifiers (naive Bayes, fastText, and a Llama 2-based model) are compared for accuracy. Findings provide insights into mitigating AI use in academic writing while maintaining assessment validity.

Summary

This presentation explores the use of generative language models by students in tertiary education contexts and how the use of text classification might be applied to detect LLM-generated writing. Using essays from L1 Japanese learners of English and Llama 2, three classifiers—naive Bayes, fastText, and a Llama 2-based model—are compared for accuracy. Findings provide insights into mitigating AI use in academic writing while maintaining assessment validity.

Teaching Context College and university education

Author

Anthony Diaz (University of California, Davis)

Presentation materials

There are no materials yet.