Assessing student perceptions and use of instructor versus AI‐generated feedback.
Saved in:
| Title: | Assessing student perceptions and use of instructor versus AI‐generated feedback. |
|---|---|
| Authors: | Er, Erkan1 (AUTHOR) erkane@metu.edu.tr, Akçapınar, Gökhan2 (AUTHOR), Bayazıt, Alper3 (AUTHOR), Noroozi, Omid4 (AUTHOR), Banihashem, Seyyed Kazem4,5 (AUTHOR) |
| Source: | British Journal of Educational Technology. May2025, Vol. 56 Issue 3, p1074-1091. 18p. |
| Subject Terms: | *Psychology of students, *Artificial intelligence, *Psychological feedback, Language models, Statistical significance, ChatGPT |
| Abstract: | Despite the growing research interest in the use of large language models for feedback provision, it still remains unknown how students perceive and use AI‐generated feedback compared to instructor feedback in authentic settings. To address this gap, this study compared instructor and AI‐generated feedback in a Java programming course through an experimental research design where students were randomly assigned to either condition. Both feedback providers used the same assessment rubric, and students were asked to improve their work based on the feedback. The feedback perceptions scale and students' laboratory assignment scores were compared in both conditions. Results showed that students perceived instructor feedback as significantly more useful than AI feedback. While instructor feedback was also perceived as more fair, developmental and encouraging, these differences were not statistically significant. Importantly, students receiving instructor feedback showed significantly greater improvements in their lab scores compared to those receiving AI feedback, even after controlling for their initial knowledge levels. Based on the findings, we posit that AI models potentially need to be trained on data specific to educational contexts and hybrid feedback models that combine AI's and instructors' strengths should be considered for effective feedback practices. Practitioner notesWhat is already known about this topicFeedback is crucial for student learning in programming education.Providing detailed personalised feedback is challenging for instructors.AI‐powered solutions like ChatGPT can be effective in feedback provision.Existing research is limited and shows mixed results about AI‐generated feedback.What this paper addsThe effectiveness of AI‐generated feedback was compared to instructor feedback.Both feedback types received positive perceptions, but instructor feedback was seen as more useful.Instructor feedback led to greater score improvements in the programming task.Implications for practice and/or policyAI should not be the sole source of feedback, as human expertise is crucial.AI models should be trained on context‐specific data to improve feedback actionability.Hybrid feedback models should be considered for a scalable and effective approach. [ABSTRACT FROM AUTHOR] |
| Copyright of British Journal of Educational Technology is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | Despite the growing research interest in the use of large language models for feedback provision, it still remains unknown how students perceive and use AI‐generated feedback compared to instructor feedback in authentic settings. To address this gap, this study compared instructor and AI‐generated feedback in a Java programming course through an experimental research design where students were randomly assigned to either condition. Both feedback providers used the same assessment rubric, and students were asked to improve their work based on the feedback. The feedback perceptions scale and students' laboratory assignment scores were compared in both conditions. Results showed that students perceived instructor feedback as significantly more useful than AI feedback. While instructor feedback was also perceived as more fair, developmental and encouraging, these differences were not statistically significant. Importantly, students receiving instructor feedback showed significantly greater improvements in their lab scores compared to those receiving AI feedback, even after controlling for their initial knowledge levels. Based on the findings, we posit that AI models potentially need to be trained on data specific to educational contexts and hybrid feedback models that combine AI's and instructors' strengths should be considered for effective feedback practices. Practitioner notesWhat is already known about this topicFeedback is crucial for student learning in programming education.Providing detailed personalised feedback is challenging for instructors.AI‐powered solutions like ChatGPT can be effective in feedback provision.Existing research is limited and shows mixed results about AI‐generated feedback.What this paper addsThe effectiveness of AI‐generated feedback was compared to instructor feedback.Both feedback types received positive perceptions, but instructor feedback was seen as more useful.Instructor feedback led to greater score improvements in the programming task.Implications for practice and/or policyAI should not be the sole source of feedback, as human expertise is crucial.AI models should be trained on context‐specific data to improve feedback actionability.Hybrid feedback models should be considered for a scalable and effective approach. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 00071013 |
| DOI: | 10.1111/bjet.13558 |
