Feedforwarding Diagnostic Language Assessment: Artificial Intelligence- (AI-) Driven Weakness Identification and Contextualised Feedback for Second Language Speaking
Saved in:
| Title: | Feedforwarding Diagnostic Language Assessment: Artificial Intelligence- (AI-) Driven Weakness Identification and Contextualised Feedback for Second Language Speaking |
|---|---|
| Language: | English |
| Authors: | Shungo Suzuki (ORCID |
| Source: | Language Testing. 2025 42(4):476-507. |
| Availability: | SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com |
| Peer Reviewed: | Y |
| Page Count: | 32 |
| Publication Date: | 2025 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | English (Second Language), Speech Skills, Artificial Intelligence, Second Language Learning, Language Usage, Feedback (Response), Second Language Instruction, Repetition, Transfer of Training, Foreign Countries, College Students, Private Colleges |
| Geographic Terms: | Japan |
| DOI: | 10.1177/02655322251348725 |
| ISSN: | 0265-5322 1477-0946 |
| Abstract: | The current study proposes a new approach to weakness identification in diagnostic language assessment (DLA) for speaking skills. We also propose to design actionable and contextualised diagnostic feedback through the systematic integration of feedback and remedial learning activities. Focusing on lexical use in second language speaking, the current study developed and validated our DLA programme in terms of actual learning gains, using an experimental design. A total of 59 beginner-to-intermediate-level Japanese learners of English were randomly assigned to control or experimental groups. While both groups engaged in task repetition with a conversational artificial intelligence (AI) agent on six occasions, only the experimental group received the diagnostic feedback on lexical use including the paraphrased utterances of their original utterance. The results showed that the control group (task repetition only) demonstrated significant improvement during the task repetition sessions but failed to transfer and retain the learning gains. In contrast, despite the lack of practice effects, the experimental group (task repetition with diagnostic feedback) outperformed the control group at the posttest with a near-medium effect size. A qualitative investigation into learners' perceptions further confirmed that the proposed contextualised diagnostic feedback succeeded in heightening their awareness of weaknesses. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1486520 |
| Database: | ERIC |
| Abstract: | The current study proposes a new approach to weakness identification in diagnostic language assessment (DLA) for speaking skills. We also propose to design actionable and contextualised diagnostic feedback through the systematic integration of feedback and remedial learning activities. Focusing on lexical use in second language speaking, the current study developed and validated our DLA programme in terms of actual learning gains, using an experimental design. A total of 59 beginner-to-intermediate-level Japanese learners of English were randomly assigned to control or experimental groups. While both groups engaged in task repetition with a conversational artificial intelligence (AI) agent on six occasions, only the experimental group received the diagnostic feedback on lexical use including the paraphrased utterances of their original utterance. The results showed that the control group (task repetition only) demonstrated significant improvement during the task repetition sessions but failed to transfer and retain the learning gains. In contrast, despite the lack of practice effects, the experimental group (task repetition with diagnostic feedback) outperformed the control group at the posttest with a near-medium effect size. A qualitative investigation into learners' perceptions further confirmed that the proposed contextualised diagnostic feedback succeeded in heightening their awareness of weaknesses. |
|---|---|
| ISSN: | 0265-5322 1477-0946 |
| DOI: | 10.1177/02655322251348725 |
