17–19 May 2024
Meijo University Nagoya Dome Campus
Asia/Tokyo timezone

Using Gaze and AI Technology to Assess Online Presence

18 May 2024, 10:50
30m
DN 404 (North Building)

DN 404 (North Building)

Research Presentation (30 minutes) Innovative Teaching Using Technology DN 404: Innovative Teaching Using Technology

Speaker

Todd Cooper

Description

When communicating in a second language, communicative competence, as defined by Canale and Swain (1980), is crucial. Having the appropriate vocabulary is merely a component of our whole conversation. Current research has suggested that when effectively communicating, the ratio of verbal communication to nonverbal is about 50-50 (Tiferes et al., 2019). Additionally, we must be cognizant of our facial expressions, which can enhance our nonverbal communication competence, particularly in online presentations and interviews (author et al., retracted, 2021). We describe the outcomes of two experiments in this study. Initially, the online mock job interviews of the pupils were recorded in both English and Japanese. Two human judges and an AI emotion analyzer assessed these facial expressions. In the second experiment, we analyzed students' interactions with a simulated online interview using gaze-tracking equipment (author et al., retracted, 2022). Using a participatory action research-based approach, we assess the responses provided in L1 and L2 for conventional job interview inquiries, reassess our procedures, and enhance our methodologies. Our research endeavors to assist students in achieving success during job interviews, irrespective of the language or cultural barriers.

Keywords AI, gaze, online presence, interviews

Primary author

Co-authors

Prof. Akira Tsukada (Toyama Institute of Technology) Ms Miho Takano (University of Toyama) Ren Nou (Toyama Institute of Technology)

Presentation materials

There are no materials yet.