Unlocking the potential of Socratic tutoring powered by large language model: A pilot study.
Saved in:
| Title: | Unlocking the potential of Socratic tutoring powered by large language model: A pilot study. |
|---|---|
| Authors: | Lang, Yueru1,2,3 langyueru_michelle@163.com, Hu, Xiangen4 xiangen.hu@polyu.edu.hk, Gong, Shaoying1,2,3 gongsy@ccnu.edu.cn, Wei, Huiling1,2,3 18154018518@163.com |
| Source: | Educational Technology & Society. Apr2026, Vol. 29 Issue 2, p69-83. 15p. |
| Subject Terms: | *Intelligent tutoring systems, *Tutors & tutoring, *Academic achievement, Sentiment analysis, User experience, Language models, Pilot projects, Generative pre-trained transformers |
| Abstract: | This pilot study introduced a conversational intelligent tutoring system named Socratic Playground for Learning (SPL) as a promising solution for simulating Socratic tutoring powered by GPT-4. It preliminarily investigated the effectiveness of Large Language Model-powered Socratic Tutoring (LLM-ST) in learning gains and user experience. Results showed that: SPL could provide learners with high-quality content. Participants achieved an average learning gain of 18.43%. Additionally, the user experience was generally positive during learning: participants experienced higher levels of positive emotions and lower levels of negative emotions, with a notable reduction in negative emotions following the learning phase. Log analysis revealed that learners rarely expressed positive and negative emotions during interactions with SPL, and confusion was the primary emotion when expressed. Semi-structured interviews with participants indicated that SPL was effective in facilitating learning (e.g., supporting knowledge mastery and inspiring thinking), while also gathering valuable feedback for further improvements (e.g., simplifying learning phases and providing detailed guidance). These findings suggest that LLM-ST has the potential to facilitate knowledge acquisition and provide a positive user experience. [ABSTRACT FROM AUTHOR] |
| Copyright of Educational Technology & Society is the property of International Forum of Educational Technology & Society (IFETS) and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
Be the first to leave a comment!
