17–19 May 2024
Meijo University Nagoya Dome Campus
Asia/Tokyo timezone

Using GPT-3 as a More Knowledgeable Other to Provide Feedback on English Language Learners’ Spoken Transcripts

18 May 2024, 16:20
30m
DN 403 (North Building)

DN 403 (North Building)

Research Presentation (30 minutes) AI for Teaching DN 403: AI for Teaching

Speaker

Paul Raine (Ritsumeikan University)

Description

Recent advancements in Generative Pre-trained Transformers (GPT) have opened up new possibilities for language teaching and learning. Leveraging the Vygotskian concepts of the More Knowledgeable Other (MKO) and the Zone of Proximal Development (ZPD), this report presents an investigation of the viability of GPT-3 as an MKO for English Language Learners (ELLs). The study introduces the SpeechCoach web application (www.speechcoach.io), which integrates GPT-3 through its Application Programming Interface (API). The participants in this study (n=680) overwhelmingly rated the feedback given by SpeechCoach on their spoken transcripts as “very helpful”, indicating its effectiveness. Follow-up interviews with six participants further confirm that the feedback is particularly beneficial for intermediate-level adult English learners, assisting them in advancing within their ZPD. Although this research shows promise for the GPT-based SpeechCoach system, it requires further refinement, and it is important to acknowledge the limitations inherent in such systems.

Keywords Vygotsky, More Knowledgeable Other, Zone of Proximal Development, Automatic Speech Recognition

Primary author

Paul Raine (Ritsumeikan University)

Presentation materials