Assessment of Learner Engagement and Expert Evaluations of AI-Generated versus Human-Created Interactive Content in an Online Course
Saved in:
| Title: | Assessment of Learner Engagement and Expert Evaluations of AI-Generated versus Human-Created Interactive Content in an Online Course |
|---|---|
| Language: | English |
| Authors: | Hamza Aydemir, Seyda Kir |
| Source: | International Review of Research in Open and Distributed Learning. 2025 26(4):1-23. |
| Availability: | Athabasca University Press. 1200, 10011-109 Street, Edmonton, AB T5J 3S8, Canada. Tel: 780-497-3412; Fax: 780-421-3298; e-mail: irrodl@athabascau.ca; Web site: http://www.irrodl.org |
| Peer Reviewed: | Y |
| Page Count: | 23 |
| Publication Date: | 2025 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Learner Engagement, Online Courses, Artificial Intelligence, Evaluation Methods, Instructional Materials, Educational Quality, Instructional Material Evaluation, Foreign Countries, Universities, Programming, Computer Science Education, Distance Education, Technology Uses in Education, Opinions, Expertise |
| Geographic Terms: | Turkey |
| ISSN: | 1492-3831 |
| Abstract: | Generative artificial intelligence (GenAI) has introduced a novel aspect to educational methodologies and sparked fresh dialogues regarding the creation and evaluation of instructional resources. This project seeks to investigate the impact of GenAI on the development and assessment of online course materials and learners' engagement with these materials in the online learning environment. The study analyzed GenAI-generated multiple-choice questions, fill-in-the-blank exercises, and true-false activities during 3 weeks of a 14-week online course. Subject matter experts assessed these documents in regards to content, relevance, and clarity. Data was collected through an online form with open-ended questions. The interactions of learners with the GenAI-created learning activities were analyzed using log records of the learning management system and compared to the content provided by the course instructor regarding interaction levels. The study's conclusions elucidate the capability of GenAI technologies to produce course-specific content and their efficacy in education. We stress that human specialists' critical evaluations play a crucial part in improving the pedagogical validity of GenAI-powered learning materials. Further research into topics including the ethical dimension, the effect on academic achievement, and student motivation is recommended. |
| Abstractor: | As Provided |
| Entry Date: | 2026 |
| Accession Number: | EJ1492278 |
| Database: | ERIC |
| Abstract: | Generative artificial intelligence (GenAI) has introduced a novel aspect to educational methodologies and sparked fresh dialogues regarding the creation and evaluation of instructional resources. This project seeks to investigate the impact of GenAI on the development and assessment of online course materials and learners' engagement with these materials in the online learning environment. The study analyzed GenAI-generated multiple-choice questions, fill-in-the-blank exercises, and true-false activities during 3 weeks of a 14-week online course. Subject matter experts assessed these documents in regards to content, relevance, and clarity. Data was collected through an online form with open-ended questions. The interactions of learners with the GenAI-created learning activities were analyzed using log records of the learning management system and compared to the content provided by the course instructor regarding interaction levels. The study's conclusions elucidate the capability of GenAI technologies to produce course-specific content and their efficacy in education. We stress that human specialists' critical evaluations play a crucial part in improving the pedagogical validity of GenAI-powered learning materials. Further research into topics including the ethical dimension, the effect on academic achievement, and student motivation is recommended. |
|---|---|
| ISSN: | 1492-3831 |
