Speaker
Description
This presentation will explore the efficacy of an automated scoring method for the Paused Transcription (PT) listening task. Transcription accuracy was analyzed using both partial-credit and ‘all-or-nothing’ binary scoring approaches across various assessment criteria. The binary method yielded results comparable to the partial-credit method in terms of PT score reliability and correlation with TOEIC Listening scores. Although further validation is necessary, this finding promotes PT’s viability as an efficient and cost-effective L2 listening assessment tool.
Summary
This presentation will explore the efficacy of an automated scoring method for the Paused Transcription (PT) listening task. Transcription accuracy was analyzed using both partial-credit and ‘all-or-nothing’ binary scoring approaches across various assessment criteria. The binary method yielded results comparable to the partial-credit method in terms of PT score reliability and correlation with TOEIC Listening scores. Although further validation is necessary, this finding promotes PT’s viability as an efficient and cost-effective L2 listening assessment tool.
| Teaching Context | College and university education |
|---|
