View in EDS HTML Full Text PDF Full Text

Taking Adaptive Learning in Educational Settings to the Next Level: Leveraging Natural Language Processing for Improved Personalization

Saved in:
Bibliographic Details
Title: Taking Adaptive Learning in Educational Settings to the Next Level: Leveraging Natural Language Processing for Improved Personalization
Language: English
Authors: Mathias Mejeh (ORCID 0000-0003-4923-8936), Martin Rehm
Source: Educational Technology Research and Development. 2024 72(3):1597-1621.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 25
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Education Level: High Schools
Secondary Education
Descriptors: Educational Environment, Natural Language Processing, Educational Technology, High School Students, High School Teachers, Student Needs, Design Requirements, Design, Educational Cooperation, Educational Researchers, Partnerships in Education, Technology Uses in Education, Individualized Instruction, Self Management
DOI: 10.1007/s11423-024-10345-1
ISSN: 1042-1629
1556-6501
Abstract: Educational technology plays an increasingly significant role in supporting Self-Regulated Learning (SRL), while the importance of Adaptive Learning Technology (ALT) grows due to its ability to provide personalized support for learners. Despite recognizing the potential of ALT to be influential in SRL, effectively addressing pedagogical concerns about using ALT to enhance students' SRL remains an ongoing challenge. Consequently, learners can develop perceptions that ALT is not customized to their specific needs, resulting in critical or dismissive attitudes towards such systems. This study therefore explores the potential of combining Natural Language Processing (NLP) to enhance real-time contextual adaptive learning within an ALT to support learners' SRL. In addressing this question, our approach consisted of two steps. Initially, we focused on developing an ALT that incorporates learners' needs. Subsequently, we explored the potential of NLP to capture pertinent learner information essential for providing adaptive support in SRL. In order to ensure direct applicability to pedagogical practice, we engaged in a one-year co-design phase with a high school. Qualitative data was collected to evaluate the implementation of the ALT and to check complementary possibilities to enhance SRL by potentially adding NLP. Our findings indicate that the learning technology we developed has been well-received and implemented in practice. However, there is potential for further development, particularly in terms of providing adaptive support for students. It is evident that a meaningful integration of NLP and ALT holds substantial promise for future enhancements, enabling sustainable support for learners SRL.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1430623
Database: ERIC
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwH-JAGmXeAzdlTeqwSYtJFRAAAA4jCB3wYJKoZIhvcNAQcGoIHRMIHOAgEAMIHIBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDDKpjWCW8trsjAP2fQIBEICBmhK5DuMobXFX3nQJT4PXJFaZyECzYyfu6IVa_KY8JapMtwxK15JxHIljczSOERt8dze9KGBq_mCU1hywr6R1N2wLhRVBe9ZGPbznkFZXxZacGufKXjpLSKIwEXR1CzHRZhvCURquIO8xO7Ml_pI6fEI5dK_fdobxqOw1yxFcm3cLeEHlS9EPg-YX4MUug0TnB-9kKz51SqHEkGU=
Text:
  Availability: 1
  Value: <anid>AN0178414888;etr01jun.24;2024Jul16.05:30;v2.2.500</anid> <title id="AN0178414888-1">Taking adaptive learning in educational settings to the next level: leveraging natural language processing for improved personalization </title> <p>Educational technology plays an increasingly significant role in supporting Self-Regulated Learning (SRL), while the importance of Adaptive Learning Technology (ALT) grows due to its ability to provide personalized support for learners. Despite recognizing the potential of ALT to be influential in SRL, effectively addressing pedagogical concerns about using ALT to enhance students' SRL remains an ongoing challenge. Consequently, learners can develop perceptions that ALT is not customized to their specific needs, resulting in critical or dismissive attitudes towards such systems. This study therefore explores the potential of combining Natural Language Processing (NLP) to enhance real-time contextual adaptive learning within an ALT to support learners' SRL. In addressing this question, our approach consisted of two steps. Initially, we focused on developing an ALT that incorporates learners' needs. Subsequently, we explored the potential of NLP to capture pertinent learner information essential for providing adaptive support in SRL. In order to ensure direct applicability to pedagogical practice, we engaged in a one-year co-design phase with a high school. Qualitative data was collected to evaluate the implementation of the ALT and to check complementary possibilities to enhance SRL by potentially adding NLP. Our findings indicate that the learning technology we developed has been well-received and implemented in practice. However, there is potential for further development, particularly in terms of providing adaptive support for students. It is evident that a meaningful integration of NLP and ALT holds substantial promise for future enhancements, enabling sustainable support for learners SRL.</p> <p>Keywords: Self-regulated learning; Adaptive learning technology; Natural language processing; Co-design</p> <p>Supplementary Information The online version contains supplementary material available at https://doi.org/10.1007/s11423-024-10345-1.</p> <hd id="AN0178414888-2">Introduction</hd> <p>In the course of societal megatrends such as globalization, demographic change, or digitization, new impulses for schools have emerged in recent years, which require new approaches to designing learning environments and promoting sustainable learning processes (OECD, [<reflink idref="bib65" id="ref1">65</reflink>]). Lifelong learning is therefore increasingly becoming the focus for a more equitable and sustainable society, with the educational system playing an essential role (Bolhuis, [<reflink idref="bib15" id="ref2">15</reflink>]; UNESCO, [<reflink idref="bib83" id="ref3">83</reflink>]). Self-regulated learning (SRL) processes are essential for lifelong learning and are widely regarded as the cornerstone of education in the twenty-first century (Anthonysamy et al., [<reflink idref="bib2" id="ref4">2</reflink>]; Lüftenegger et al., [<reflink idref="bib49" id="ref5">49</reflink>]; Taranto & Buchanan, [<reflink idref="bib81" id="ref6">81</reflink>]; Wigfield et al., [<reflink idref="bib88" id="ref7">88</reflink>]). This raises the question of how schools as educational organizations should enable students' SRL to cope with the challenges of social transformative processes. Fueled by the digitalization of educational systems (Beller, [<reflink idref="bib10" id="ref8">10</reflink>]; Scherer et al., [<reflink idref="bib76" id="ref9">76</reflink>]), SRL is increasingly supported by digital media, such as learning platforms, learning management systems, chatbots, or apps (Broadbent & Poon, [<reflink idref="bib18" id="ref10">18</reflink>]; Broadbent et al., [<reflink idref="bib17" id="ref11">17</reflink>]). From an educational science perspective, the primary goal is to support the learning and educational process of learners, ideally tailored to their individual learning process, to optimally accompany and improve learning (Azevedo & Gašević, [<reflink idref="bib6" id="ref12">6</reflink>]), also referred to as Adaptive Learning Technology (ALT). While the quantity of research on ALT has significantly increased in recent decades (Martin et al., [<reflink idref="bib52" id="ref13">52</reflink>]), and its usage in pedagogical practices is becoming more widespread (Broadbent & Poon, [<reflink idref="bib18" id="ref14">18</reflink>]; Molenaar et al., [<reflink idref="bib57" id="ref15">57</reflink>]), questions still exist about the technical and pedagogical requirements of ALTs. These requirements are necessary to provide learners with personalized and timely support throughout their learning process (Martin et al., [<reflink idref="bib52" id="ref16">52</reflink>]). Our paper makes a unique contribution by enhancing the capabilities of adaptive learning as a technology for regulating individual learning. This is accomplished by exploring the potential of integrating an ALT with artificial intelligence, specifically natural language processing (NLP). We thereby address three identified gaps in previous research. First, there is a call for more studies like ours, as "NLP technologies have the great potential to provide and advance precision education and personalized learning" (Chen et al., [<reflink idref="bib22" id="ref17">22</reflink>], p. 15). Second, we not only employ NLP in the context of ALT, but also base all NLP decisions and configurations on a sound, qualitatively informed theoretical and empirical framework that draws from research in educational studies (Zawacki-Richter et al., [<reflink idref="bib95" id="ref18">95</reflink>]). Finally, we tackle a growing concern that questions the perceived preference for using quantitative methods in ALT. Scholars instead suggest a more integrative combination of NLP and qualitative methods, such as interviews (Cheligeer et al., [<reflink idref="bib21" id="ref19">21</reflink>]; Guetterman et al., [<reflink idref="bib36" id="ref20">36</reflink>]), to design and implement meaningful and effective ALTs to foster SRL.</p> <hd id="AN0178414888-3">Adaptive learning technology</hd> <p>ALT is a collection of educational software tools and systems that utilize data analytics and machine learning algorithms to offer tailored learning experiences to individual students, taking into account their particular needs, strengths, and weaknesses (Imhof et al., [<reflink idref="bib38" id="ref21">38</reflink>]; Kurilovas et al., [<reflink idref="bib46" id="ref22">46</reflink>]; Nakic et al., [<reflink idref="bib61" id="ref23">61</reflink>]; Pelletier, [<reflink idref="bib67" id="ref24">67</reflink>]). Therefore, ALT's aim to personalize education for better student learning by identifying their learning gaps, recommending relevant content, and assessing their progress until a learning objective is met (Kerr, [<reflink idref="bib41" id="ref25">41</reflink>]; Petersen et al., [<reflink idref="bib70" id="ref26">70</reflink>]; Xie et al., [<reflink idref="bib94" id="ref27">94</reflink>]). The concept of adaptive learning has a long tradition in learning research and is closely related to other concepts such as personalized learning, student-centered education, individualization, and differentiated instruction (Schmid et al., [<reflink idref="bib77" id="ref28">77</reflink>]). Throughout the history of education, skilled educators have been known to adapt to the unique needs of their students by making adjustments such as altering the method of presenting information, adjusting the academic level, changing the order of tasks, and providing customized guidance and feedback (Petersen et al., [<reflink idref="bib70" id="ref29">70</reflink>]). Due to the rapid development and use of information and communication technology in schools and classrooms (Scherer et al., [<reflink idref="bib76" id="ref30">76</reflink>]), the potential of ALT has increasingly expanded and provided a wide range of new opportunities in school practice and research (Martin et al., [<reflink idref="bib52" id="ref31">52</reflink>]).</p> <hd id="AN0178414888-4">How is adaptive learning technology connected to self-regulated learning?</hd> <p>SRL involves a hierarchical, adaptive process in which learners analyze a task, set goals and plans, and use strategies to achieve them with motivational and affective factors being critical to initiating and sustaining goal attainment. The learning process and goal attainment are monitored through metacognitive strategies and the effective use of self-regulatory strategies, which vary based on the task and context (Greene et al., [<reflink idref="bib35" id="ref32">35</reflink>]). Continuous diagnosis of students' SRL competences is crucial, and is accomplished through teachers coaching and providing feedback related to SRL (Butler & Winne, [<reflink idref="bib19" id="ref33">19</reflink>]; Karlen et al., [<reflink idref="bib40" id="ref34">40</reflink>]; Klug et al., [<reflink idref="bib43" id="ref35">43</reflink>]; Nicol & Macfarlane‐Dick, [<reflink idref="bib63" id="ref36">63</reflink>]; Tempelaar, [<reflink idref="bib82" id="ref37">82</reflink>]). Gradually shifting responsibility from teachers to students is a key aspect of supporting SRL. This involves moving from externally regulated learning to co-regulated learning, and ultimately to students' SRL (van Beek et al., [<reflink idref="bib84" id="ref38">84</reflink>]; van de Pol et al., [<reflink idref="bib85" id="ref39">85</reflink>]). ALTs can provide learners with greater flexibility in practicing SRL by assisting them in responsibly utilizing the opportunities presented in learning situations (Park et al., [<reflink idref="bib66" id="ref40">66</reflink>]; Winne, [<reflink idref="bib89" id="ref41">89</reflink>]).</p> <p>Researchers traditionally used cognitive or constructivist models to explain learning with ALTs, but recently, some have advanced metacognitive and SRL models to describe the complex mediating processes involved in students' learning with technology (Azevedo & Gašević, [<reflink idref="bib6" id="ref42">6</reflink>]; Winne & Azevedo, [<reflink idref="bib90" id="ref43">90</reflink>]). For example, Molenaar and colleagues refer to the COPES Model (Winne & Hadwin, [<reflink idref="bib91" id="ref44">91</reflink>]) when they state that "in adaptive learning technologies [...] part of the control and monitoring loop is taken over by the technology." (Molenaar et al., [<reflink idref="bib57" id="ref45">57</reflink>], p. 2). The influence of ALT on successful SRL has been widely demonstrated (e.g., Aleven et al., [<reflink idref="bib1" id="ref46">1</reflink>]; Molenaar & Van Campen, [<reflink idref="bib58" id="ref47">58</reflink>]). Forsyth et al. ([<reflink idref="bib30" id="ref48">30</reflink>]) were able to show that ALT can be used to identify weaknesses in students' SRL and improve them through the use of clear goals. To do this, they used an Automated Grading Learning System that helped learners evaluate their learning and allowed instructors to provide timely and individualized feedback. Furthermore, it has been shown that ALTs can have a positive impact on students' academic performance and motivation (Faber et al., [<reflink idref="bib27" id="ref49">27</reflink>]) as well as on the successful adaptation of learning behaviors (Molenaar et al., [<reflink idref="bib57" id="ref50">57</reflink>]). Azevedo et al. ([<reflink idref="bib4" id="ref51">4</reflink>]) stipulated that a crucial aspect of ALTs is their ability to facilitate students' SRL through scaffolding, fostering, and supporting cognitive, affective and metacognitive processes.</p> <p>Despite the research demonstrating the impact of ALTs on SRL, there is a substantial body of interdisciplinary evidence suggesting that learners often show signs of dysregulated learning (Azevedo & Feyzi-Behnagh, [<reflink idref="bib5" id="ref52">5</reflink>]). In essence, this describes a situation where learners, due to maladaptive framework conditions in the classroom or delayed feedback—not utilize these processes to regulate their own learning or adaptively modify their behavior. This challenge is closely linked to what Xie and colleagues describe as "readiness" ([<reflink idref="bib94" id="ref53">94</reflink>], p. 13), which emphasizes the importance of considering the experiences and contexts that enable students to be motivated and capable of learning in class. For example, research has shown that although a personalized creativity learning system provides customized learning paths by utilizing richer data sources such as user input and questionnaire responses during learning, the level of user effort required is too high (Lin et al., 2013) Integrating context-aware user data collection techniques into technology-enhanced learning is critical for achieving real-time context-aware adaptive learning (Xie et al., [<reflink idref="bib94" id="ref54">94</reflink>]).</p> <hd id="AN0178414888-5">Natural language processing</hd> <p>NLP refers to "the computational examination of texts' linguistic properties" (Crossley et al., [<reflink idref="bib25" id="ref55">25</reflink>], p. 7) that can handle large amounts of text data that are being produced, among others, within ALT. Generally, NLP has been suggested to provide a systematic approach to enable computer-based scaffolding (Raković, et al., [<reflink idref="bib72" id="ref56">72</reflink>]). The underlying notion describes a process whereby students interact with a piece of ALT software, which provides them with formative feedback, informing their SRL, and then gradually being faded out. In their conceptual work, Graesser and McNamara ([<reflink idref="bib34" id="ref57">34</reflink>]) refer to these types of software solutions as "pedagogical agents" (p. 3) that can encourage students to consider and implement particular SRL strategies and plans. For these pedagogical agents to work efficiently, the authors stipulate that statistical measures in computational linguistics, such as NLP, can greatly contribute to streamlining the process of identifying matches and gaps in students' SRL, regarding predetermined and suggested self-regulatory strategies. Araka and colleagues ([<reflink idref="bib3" id="ref58">3</reflink>]) suggested that NLP provides a valuable toolkit that can aid teachers to monitor and influence students' learning paths within bound SRL trajectories. For example, the integration of NLP into ALTs has demonstrated the enhanced recognition and support of emotion regulation strategies and scaffolding among students (Azevedo et al., 2022). The application of NLP has proven its potential to provide more precise individualized support for learners, exemplified through the use of chatbots (Sáiz-Manzanares et al., [<reflink idref="bib75" id="ref59">75</reflink>]). Within this context, Gabriel and colleagues (2022) indicate that complementing more qualitative instruments and methodological approaches with NLP can greatly contribute to revealing and supporting the dynamic nature of SRL. Similarly, Crossley and colleagues ([<reflink idref="bib25" id="ref60">25</reflink>]) employed NLP, in combination click-stream data and test results, to investigate students' completion rates in massive open online courses. In their study, the authors used a range of different NLP measures, including sentiment analysis to effectively monitor and evaluate students' task performance. Based on their promising results, the authors concluded that NLP can provide innovative and valuable information in the context of ALT. Even more so, they call for increased use of NLP in order to develop more rigorous models for SRL that are independent of domains and specific contexts. Raković and colleagues ([<reflink idref="bib72" id="ref61">72</reflink>]) depart from a similar notion and argue that NLP and the analysis of linguistic features constitute valuable resources to better understand and possibly anticipate students' SRL decisions. In another study, they used data from a large introductory biology course and examined how evaluation and adoption, informed by NLP, can shape and influence students' SRL (Raković et al., [<reflink idref="bib71" id="ref62">71</reflink>]). Among others, the authors used opinion mining (Liu, [<reflink idref="bib48" id="ref63">48</reflink>]) and Part-of-Speech tagging (POS) (Chiche & Yitagesu, [<reflink idref="bib23" id="ref64">23</reflink>]) to develop a computational system that evaluated students' metacognitive evaluations and plans, and then prompted reflective responses, depending on the input of the students. Their findings provide insights and support for the notion of NLP adding a valuable dimension to better understand and inform SRL, particularly among underachieving students.</p> <hd id="AN0178414888-6">Research questions</hd> <p>ALT is prominently featured as an important development in educational technology in the 2018 Horizon report (Becker et al., [<reflink idref="bib9" id="ref65">9</reflink>]). ALTs supported by computational techniques such as NLP are continually evolving to provide adaptive and personalized support to learners (Moreno-Guerrero et al., [<reflink idref="bib59" id="ref66">59</reflink>]; Mousavinasab et al., [<reflink idref="bib60" id="ref67">60</reflink>]). Despite the potential benefits of incorporating context-aware user data collection techniques in technology-enhanced learning, there remains a challenge in addressing pedagogical issues related to the entire learning-teaching process, which are often overlooked (Zhang & Aslan, [<reflink idref="bib97" id="ref68">97</reflink>]). In this context, scholars like Zawacki-Richter and colleagues ([<reflink idref="bib95" id="ref69">95</reflink>]) argue that current ALT applications and approaches are often-times lacking a foundation in pedagogical practice. This is underlined by the scarcity of empirical studies that utilize ALT in pedagogical settings (Cavanagh et al., [<reflink idref="bib20" id="ref70">20</reflink>]; Imhof et al., [<reflink idref="bib38" id="ref71">38</reflink>]). According to Kabudi et al. ([<reflink idref="bib39" id="ref72">39</reflink>]), despite evidence of ALT-enhanced learning interventions, challenges persist in effectively addressing learners' abilities and issues. As a result, learners perceive ALTs as not being tailored to their individual needs, leading to critical, dismissive or even dysfunctional attitudes towards these systems. Moreover, adaptive mobile systems do not exist as they demand educational researchers to have up-to-date IT skills and require building from scratch (Xie et al., [<reflink idref="bib94" id="ref73">94</reflink>]).</p> <p>Successful learning with ALTs depends on learners being able to adaptively regulate their cognitive and metacognitive behaviors during the learning process. As such, challenges, particularly in the advancement of SRL, can arise due to this dependence (Azevedo & Gasevic, [<reflink idref="bib6" id="ref74">6</reflink>]; Winne, [<reflink idref="bib89" id="ref75">89</reflink>]). But according to Azevedo and Feyzi-Behnagh ([<reflink idref="bib5" id="ref76">5</reflink>]), it is often the case that learners are not capable of adaptively adjust their learning behavior. Therefore, there is a need to make ALTs even more effective and accessible just-in-time in promoting SRL (Azevedo et al., [<reflink idref="bib7" id="ref77">7</reflink>]). Hence, in this paper the overarching research question is as follows:</p> <p>What is the potential of combining NLP to improve real-time contextual adaptive learning within an ALT to support learners' SRL?</p> <p>More specifically, this question can be subdivided into the following component parts:</p> <p></p> <ulist> <item> How can an ALT be designed to effectively consider learners' needs and preferences regarding their SRL?</item> <p></p> <item> How can NLP be utilized in an ALT to effectively gather relevant information from learners to provide adaptive support in SRL?</item> </ulist> <hd id="AN0178414888-7">Method</hd> <p></p> <hd id="AN0178414888-8">Context of the study</hd> <p>The goal of this project is to collaborate with students and teachers in the development, testing, and adaptation of a tailored digital tool, aiming to offer adaptive and personalized support to both groups engaging in SRL. In order to achieve this objective, we initiated a one-year co-design process (Penuel et al., [<reflink idref="bib69" id="ref78">69</reflink>], [<reflink idref="bib68" id="ref79">68</reflink>]) in collaboration with a high school, as depicted in Fig. 1. The primary objective of this phase was to develop the tool by actively considering the needs and requirements of the learners. This involved closely collaborating with the target groups. At the core of the process was a co-design team consisting of students, teachers, and researchers. Over the course of one year, this group convened in two workshops to collaboratively assess and analyze the gathered data, drawing meaningful conclusions for the project. Initially, emphasis was placed on assessing the tool's usability, including its functionality, design, and learner interaction. The co-design process was divided into three main phases (McKercher, [<reflink idref="bib53" id="ref80">53</reflink>]):</p> <p></p> <ulist> <item> Establishing preconditions, immersion and coordination</item> <p></p> <item> Exploring, designing, and</item> <p></p> <item> Testing, refinement, implementation and learning.</item> </ulist> <p>Graph: Fig. 1 Co-design process overview</p> <p>As depicted in Fig. 1, the project started in October 2022 with the initiation of version 0 of the digital tool known as "studybuddy". This iteration evolved from a pre-existing prototype that had been earlier developed at the university. Studybuddy serves as an ALT, aimed at fostering SRL by providing learners with tailored and timely SRL strategies (Mejeh et al., in press).</p> <p>In the first phase various types of data were collected. Quantitatively, data on students' trait behaviors related to their SRL were collected using a pre-post design questionnaire. Additionally, learner trajectory data were gathered over a 5-week period to examine learners' state behavior in relation to their SRL. Qualitatively, individual interviews were conducted to perform profile analyses of individual SRL behaviors. Additionally, group interviews were conducted with teachers and students to evaluate the usability of the digital tool and determine the need for SRL support at a broader level. At the co-design group level, a questionnaire on interests and goals was administered in preparation for the first workshop in the second phase of the project.</p> <p>During the second phase, the research team examined both quantitative and qualitative data obtained from pre- and post-surveys, daily surveys, group discussions, and interviews. Workshop 1 was conducted with the co-design group to analyze the outcomes of the tool's implementation in classrooms, establish goals, gather ideas, and conduct a SWOT analysis. Following the workshop, the research team assessed the outcomes and developed prototypes for version 0.1 of the digital tool. The co-design group provided feedback on the prototypes, and once the selection of prototypes and elements was finalized, the technical implementation of version 0.1 commenced.</p> <p>The third phase consists of the testing and refinement of studybuddy version 0.1. Based on the findings from the initial two phases, we made the decision to deviate from our original approach and make adjustments to our data collection methods. Rather than conducting SRL pre-surveys, daily short questionnaires, and interviews and group discussions once again, we opted to involve more students as advisors in the co-design process. For this purpose, we actively sought out students who were interested in working in small groups to test specific enhancements of the digital tool, such as evaluating dashboards. To engage these student consultants, the research team initiated contact and assigned them small tasks (e.g., "What do you think of the new color scheme of the dashboard?"). This approach allowed us to gather valuable feedback from the students and involve them directly in the refinement of the digital tool. The feedback received from the advisors was carefully evaluated and formed the foundation for the second workshop with the co-design group. During this workshop, the feedback was thoroughly discussed and assessed, leading to the development of several prototypes for the digital tool. The co-design group collaboratively decided on a specific prototype that served as the basis for version 1.0 of the tool. Once the prototype was chosen, the development of version 1.0 commenced.</p> <hd id="AN0178414888-9">Data base</hd> <p>The study was conducted in collaboration with a Swiss high school (Canton Bern). The digital tool was utilized in three classes throughout a one-year co-design process, involving a total of 69 students who used studybuddy. Out of these 69 students, 25 voluntarily agreed to participate in interviews. The qualitative data collection during the co-design process encompassed three types of interviews: group discussions, stimulated recall, and individual interviews. The individual interviews specifically concentrated on students' SRL and their usage of studybuddy. This is the reason why these interviews were selected for analysis in this study (for the interview guide, see Appendix A). A subset of 6 students willingly took part in the individual interviews, constituting a convenience sampling approach (Robinson, [<reflink idref="bib73" id="ref81">73</reflink>]), which is commonly employed in co-design scenarios for the development of educational technology (e.g., Penuel et al., [<reflink idref="bib69" id="ref82">69</reflink>]). The six students (2 female, 3 male, 1 without gender) came from three different classes of the 11th grade. Regarding the incorporation of NLP into ALT, our current primary focus lay in understanding how pertinent information can be assimilated by students and then effectively processed by the digital tool to offer enhanced adaptive support. However, even though their perspective is often essential, the viewpoint of learners is often underrepresented in co-design processes (Garcia et al., [<reflink idref="bib31" id="ref83">31</reflink>], [<reflink idref="bib32" id="ref84">32</reflink>]; Könings et al., [<reflink idref="bib44" id="ref85">44</reflink>]).</p> <p>The students were between 16 and 17 years old. Overall, this resulted in 210 min of recorded interviews. The audio files were then transcribed using Deepgram, an automated transcription tool that uses artificial intelligence to identify conversational patterns and employs a range of speech-to-text formatting features. Departing from the established guidelines for transcribing interviews as suggested Kuckartz and Rädiker ([<reflink idref="bib45" id="ref86">45</reflink>]), we decided to configure Deepgram with an essential setup, focusing on punctuation, while neglecting pauses and emphases. Utterances were included in the transcript and taken care of by other NLP features that will be described below. After an initial inspection of the transcripts by the researchers, the transcripts were then imported into MAXQDA to perform a thorough accuracy check to ensure the fidelity of the transcriptions. The study was approved by the Human Research Ethics committee of the first authors university (Ethics approval number: 2022-10-05).</p> <hd id="AN0178414888-10">Analysis</hd> <p>In order to analyze how the integration of NLP into an ALT system could look like to provide just-in-time support to students, we employed a three-tier approach, namely using opinion mining, POS, and sentiment analysis. It is important to note that we do not employ this approach in isolation. Instead, we follow the suggestion of scholars like Zawacki-Richter and colleagues ([<reflink idref="bib95" id="ref87">95</reflink>]), who called for more quantitative approaches in ALT that are clearly informed by qualitative research, such as the indicated interviews from the co-design process, and sound theoretical considerations, as described in the preceding paragraphs of this paper.</p> <p>Opinion mining (Liu, [<reflink idref="bib48" id="ref88">48</reflink>]) refers to the use of computational linguistics to identify and extract subjective information from textual data (Varathan et al., [<reflink idref="bib86" id="ref89">86</reflink>]). This information can then be used to create lexicons, e.g., based on individuals' responses to interview questions or ALT cues, that can then be compared to reference lexicons. In the case at hand, the reference lexicons were based on the identified (meta-)cognitive, motivational, as well as emotional components that form the basis for SRL. Components were identified based on the two most widely used and reputable SRL assessment tools: the Motivated Strategies for Learning Questionnaire (MSLQ) and the Learning and Study Strategies Inventory (LASSI), as outlined by Credé and Phillips ([<reflink idref="bib24" id="ref90">24</reflink>]) and Fong et al. ([<reflink idref="bib29" id="ref91">29</reflink>]). For the MSLQ, the German LIST version (Wild & Schiefele, [<reflink idref="bib93" id="ref92">93</reflink>]) was employed, while the German WLI version (Metzger, [<reflink idref="bib55" id="ref93">55</reflink>]) was utilized for the LASSI, both of which are established adaptations. The potential overlap between individuals' responses and the SRL references was determined using cosine similarity (Lahitani et al., [<reflink idref="bib47" id="ref94">47</reflink>]), which compares the words and phrases in the applicable lexicons with each other, yielding an index ranging from 0 (completely different) to 1 (completely similar). The resulting metric allowed us to determine the degree to which individuals used terminology associated with SRL constructs such as resource management, emotion, motivation and metacognitive strategies. This provided a baseline, indicating the overall degree with which individuals were already actively using SRL-related terminology. It is important to note that the focus of the index, for the purpose of this showcase, is do identify SRL levels within individuals. A comparison between individuals is of course also possible, but at this point not at the center of this work. Next, we zoomed in to more nuanced linguistic aspects of interviewees' responses (Chen et al., [<reflink idref="bib22" id="ref95">22</reflink>]).</p> <p>Subsequently, based on the overall categorization of the responses, we conducted POS to extract keywords and phrases. The main idea of POS is to assign each word of a text to its proper syntactic tag in the context of its appearance (Chiche & Yitagesu, [<reflink idref="bib23" id="ref96">23</reflink>]). This is also referred to as grammatical tagging (Khan et al., [<reflink idref="bib42" id="ref97">42</reflink>]) and includes verbs, adjectives, adverbs, and nouns. By implementing POS, we were able to deal with the ambiguity of individual words and better evaluate and contextualize the meaning of word pairs within the sentences that they occurred. For example, opinion mining might have indicated that the overlap of an individual's response is high with respect to the SRL construct of "motivation". While proving valuable information, we are not yet able to classify whether the individual is referring to an increase of motivation (e.g. "I became more motivated") or a lack of motivation (e.g. "I got bored with the topic"). Adding POS to opinion mining provides exactly this type of additional insights that are highly relevant to provide more nuanced and tailor-made feedback and suggestions for that particular individual. For these first two steps, all data was analyzed using the R statistical software package, drawing on the libraries textstem, udpipe (Zeman et al., [<reflink idref="bib96" id="ref98">96</reflink>]) and quanteda (Benoit et al., [<reflink idref="bib12" id="ref99">12</reflink>]).</p> <p>Finally, following up on our POS argument and the notion that affective processes can be instrumental for individuals' SRL strategies (Azevedo et al., [<reflink idref="bib4" id="ref100">4</reflink>]), we also conducted sentiment analysis (Manning & Schutze, [<reflink idref="bib51" id="ref101">51</reflink>]). More specifically, in the examples provided above, POS can help to identify nuanced word combinations, but does not by itself reveal the difference between "motivated" and "bored". Adding sentiment analysis to opinion mining and POS therefore adds another valuable layer of information to support the development of more adaptive support in SRL. Sentiment analysis is usually based on the ordinal classification of emotions and opinions (Rosenthal et al., [<reflink idref="bib74" id="ref102">74</reflink>]). We used the Linguistic Inquiry and Word Count (LIWC) software (Boyd et al., [<reflink idref="bib16" id="ref103">16</reflink>]), which consists of multiple dictionaries that map written text to important psychosocial constructs and theories with words, phrases, and other linguistic constructions. More specifically, given the context of this study, we employed the DE-LIWC2015 dictionaries, as they are focused on the German language and include affective processes. These processes can be subdivided into positive emotions and negative emotions. Words that describe positive emotions include "happy", "pretty", and "good". Negative emotions, on the other hand, are further subdivided into anxiety (e.g., "nervous", "afraid"), anger (e.g., "hate", "annoyed"), and sadness (e.g., "grief", "sad"). The resulting index determines the percentage overlap between the words from the responses and the words from the DE-LIWC2015 dictionaries (Boyd et al., [<reflink idref="bib16" id="ref104">16</reflink>]).</p> <hd id="AN0178414888-11">Results</hd> <p>Based on the context of this study (see chapter 3.1), we will now describe the conceptualization of the digital tool and the needs of the students and teachers that have emerged during the first two implementation phases. This prompted us to opt for the integration of an AI empowered with NLP during the third phase. This enhancement aims to provide even more adaptive and personalized support to students in their SRL. We then proceed to showcase the outcomes of integrating NLP into the tool.</p> <hd id="AN0178414888-12">Studybuddy—a digital tool to support learners self-regulated learning</hd> <p>To support learners SRL in a context-dependent and need-based manner in real-time, we developed and implemented the digital tool studybuddy. Studybuddy is a digital platform available as both a website and an app, designed to promote SRL. The tool offers learners different forms of feedback, such as new assignments or reminders to complete tasks. The main focus of studybuddy is to provide learners with various regulation strategies that help them reflect on their learning process and make adjustments to achieve their learning goals autonomously. In this process, learners receive feedback through a range of notes and strategies in the form of prompts, providing them with direct insight into their learning process. This immediate feedback is intended to contribute to the improvement of SRL, as studybuddy engages directly with learners concerning their learning processes. Utilizing a questionnaire-based approach, SRL-related data is systematically gathered from learners over time, encompassing insights into motivation, emotion, cognition, metacognition, and resource management. This approach employs a standardized 7-point Likert scale, ranging from 1 (strongly disagree) to 7 (strongly agree), to evaluate students' self-reflection on their SRL. This questionnaire is seamlessly integrated into the digital learning environment as a brief daily survey, administered both in the morning and afternoon of a school day. If a student does not exceed a specific threshold, the app automatically prompts them with an appropriate regulation strategy. For instance, in the context of self-efficacy, learners are asked, "Do you feel optimistic that you will make good progress at studying today?". If the student selects one of the four lowest values ("strongly disagree", "disagree", "somewhat disagree", "neutral") on the 7-point Likert scale, a regulation strategy is automatically suggested (for an overview of what the daily reflection on SRL looks like, see the video in Appendix B).</p> <p>For the most part, the content and functionality of the website is the same as that of the app. The app proves to be essential in that its use allows for direct interaction with the users by sending different prompts. It is also used to display individual learning progress (dashboard function) and can be used as a planning tool, featuring a calendar and a note function.</p> <p>With the help of studybuddy, learning-related data is collected from learners over time. This means, that learning is divided into different episodes (e.g., a task, a lesson, or a whole school day) that proceed cyclically, whereby—due to a feedback loop—preceding phases influence subsequent phases (Bellhäuser et al., [<reflink idref="bib11" id="ref105">11</reflink>]). Accordingly, as to when learners receive adaptive feedback from the digital tool, depends on which learning episodes are defined and how long they are. Figure 2 depicts studybuddy's four components: an automated prompting system, a digital dashboard, personalized strategies, and a planning tool (for more details see Mejeh et al., in press). In this article, we focus on the automated prompting system and the personalized strategy delivery as part of a larger feedback system.</p> <p>Graph: Fig. 2 Overview different functions studybuddy</p> <hd id="AN0178414888-13">Automated prompting system</hd> <p>Figure 3 illustrates how the automatic prompting system works for learners via push notifications (for an overview of how the automatic prompting system works, see the video in Appendix B). This system is essential for SRL, as it helps learners to adjust their learning strategies and monitor their progress (Nicol & Macfarlane‐Dick, [<reflink idref="bib63" id="ref106">63</reflink>]). The system is pre-programmed and prompts can be send to learners at a predefined time (e.g., push notification of the start of the week) or activated individually based on their needs and preferences (e.g., push notification of new learning strategies). This has been shown to be particularly effective for SRL, as it enables learners to make timely adjustments to their learning strategies and monitor their progress (Dabbagh & Kitsantas, [<reflink idref="bib26" id="ref107">26</reflink>]). Shute ([<reflink idref="bib80" id="ref108">80</reflink>]) found that learners who received immediate and specific feedback through an ALT made significant gains in their performance compared to learners who received delayed or general feedback.</p> <p>Graph: Fig. 3 Getting a new prompt by studybuddy</p> <p>Moreover, the system can remind students of newly unlocked tasks, keeping them engaged and motivated (Seiler et al., [<reflink idref="bib79" id="ref109">79</reflink>]). Notifications are also activated based on certain behavioral patterns within the learning environment, which helps learners to reflect on their learning behaviors and improve their self-regulation skills (Bodily & Verbert, [<reflink idref="bib14" id="ref110">14</reflink>]). For instance, when a learner clicks on the "Task completed" button, a notice appears utilizing images and text material to draw their attention to the successful completion of the tasks (Ifenthaler et al., [<reflink idref="bib37" id="ref111">37</reflink>]). Additionally, notes become visible in the learning environment at predefined points in time, drawing learners' attention to the strategy recommendations or strategy collection, which can enhance their learning outcomes (Garcia et al., [<reflink idref="bib31" id="ref112">31</reflink>], [<reflink idref="bib32" id="ref113">32</reflink>]).</p> <hd id="AN0178414888-14">Personalized strategies</hd> <p>Learning Analytics (LA) can help to provide insights into how to personalize feedback and interventions to meet the unique needs of the learners (Baker & Inventado, [<reflink idref="bib8" id="ref114">8</reflink>]). As depicted in Fig. 4, this facilitates personalized LA feedback by offering individualized strategy recommendations grounded in personal motivation, emotions, cognition, metacognition, and resource management data (for an overview of how the personalized strategies system works, see the video in Appendix B).The integration of personalized strategy recommendations into a digital learning environment, such as studybuddy, can help to facilitate learners' adoption and use of these strategies, as well as provide a convenient and accessible resource for their ongoing development (e.g., Dabbagh & Kitsantas, [<reflink idref="bib26" id="ref115">26</reflink>]; Järvelä & Hadwin, 2013).</p> <p>Graph: Fig. 4 Getting a new strategy suggestion by studybuddy</p> <p>The majority of the strategies used by studybuddy are based on the German version (Metzger, [<reflink idref="bib55" id="ref116">55</reflink>]) of the Learning and Study Strategies Inventory (LASSI) (Weinstein et al., [<reflink idref="bib87" id="ref117">87</reflink>]). The individual strategies are adjusted and displayed after each collection of learner-related data, both before and after solving tasks. The format takes the form of short videos that use pictographs and text to clearly illustrate the recommended actions (for an overview of how the strategies look like, see Appendix C). For example, for motivation, one strategy is to create a sense of achievement. This involves rewarding oneself to an appropriate degree for achieving intermediate goals or embedding an unpleasant task between the completion of two pleasant tasks. In the context of emotion, learners can engage in "expressive writing", where they write down all their emotions without worrying about grammar or spelling. This activity allows them to reflect on their emotions, resulting in greater emotional regulation and control. For cognition, learners can use the "slow down" strategy, which involves going through the learning material again and taking small breaks to improve understanding and retention. In terms of metacognition, learners can manage their tasks more effectively by using the "task management" strategy, which involves diversifying their work schedule and packing unpleasant tasks between two more pleasant ones. This strategy helps learners prioritize their time, resulting in greater productivity and reduced stress. Finally, when considering resource management, learners can optimize their workspace using the "flow place" strategy, which involves identifying the best place to focus and making sure they are in that environment. By optimizing their resources, learners can better concentrate on their learning tasks. The individual strategies are adjusted and displayed after each collection of learner-related data (before and after solving the tasks, respectively).</p> <p>In summary, studybuddy is an ALT characterized by an automated feedback system and personalized strategy mediation, offering enhanced adaptability through its portability. During the initial two phases of the co-design process, it became evident that studybuddy, although already highly adaptive, required further development to increase its adaptiveness. Throughout the development process, three key areas were identified: adaptivity, strategy communication, and dashboard design. Concerning adaptivity, the co-design group proposed several enhancements. These included the ability to customize the timing of push messages, integrating a to-do list feature, establishing a collaborative forum for task editing and discussion, and incorporating artificial intelligence. Regarding strategy delivery, it was apparent that students desired various display formats for SRL strategies, a favorites function, and strategies that align effectively with specific task types. Therefore, to enhance the adaptiveness of the digital tool and better cater to learners' individual needs, efforts were made to explore the possibilities of utilizing a text recognition program (Deepgram) and an NLP AI. These components were tested using existing interview material from the co-design process.</p> <hd id="AN0178414888-15">Opinion mining, part-of-speech tagging, and sentiment analysis</hd> <p>Based on the indicated interviews and the methodological approach described, we now present some preliminary results. First, we employed opinion mining, in order to broadly define potential overlap between the words used by interviewees and the defined SRL strategies. Figure 5 below visualizes the findings. As can be seen, there is quite some variance between the different interviewees, indicating different levels of SRL proficiency. Moreover, it seems that the SRL constructs "Emotion" and "Motivation" are slightly more pronounced than the other ones, already providing valuable insights as to which SRL strategies might require more attention in the context at hand. Based on the initial lexicons, these findings already suggest that by using the similarity measure, an initial rough assessment of individual SRL-related needs can be conducted and is able to capture differences within and across individuals.</p> <p>Graph: Fig. 5 Overview of similarity measures across Interviews (grouped by SRL construct)</p> <p>Another visualization of the keywords, particularly the nouns and adjectives used in combination with each other, is depicted in Fig. 6. The aim of this type of POS tagging is to contextualize words within the framework in which they are used. The connections between words (Fig. 6), provides additional insights into how students might consider and use SRL in their daily lives. This, in turn, enables the provision of more fine-tuned and adaptive feedback and suggestions that take into account the individual context in which students engage with SRL.</p> <p>Graph: Fig. 6 Overview of identified keywords across all Interviews</p> <p>For instance, clusters of words become evident in the network surrounding key terms such as "video", "difficulty", "support", "strategy", "matter", or "situation". This can provide an initial impression of what is important to learners regarding their SRL and in which context they situate it. However, in its current form, the word network remains somewhat unclear from a purely descriptive standpoint. Therefore, the term "strategy" will be further explored in the subsequent discussion as it assumes a central role in the context of the conducted analyses.</p> <p>Figure 7 zooms in on the specific part of the interviews that dealt with "strategy".</p> <p>Graph: Fig. 7 Zooming in on POS connections around the concept of strategies</p> <p>Upon closer examination of the term "strategy" in the word network, it becomes evident that the interviewees predominantly mention it in combination with other words that suggest a promotion of SRL through a digital tool. Specifically, the link between "strategy" and terms such as "personal", "different" "new", as well as "learning", clearly indicate that the expected effect of the tool can be assumed based on the participants' discussions. The connection between the words "strategy" and "learning", indicating that they have been used in the same sentence and in relation with each other, is particularly noteworthy. This preliminary finding suggests that the tool and the project have been identified by students to support their learning on how to further improve their SRL strategies. Moreover, being able to identify this via NLP highlights the potential of the method, being part of an ALT, to enhance the automated adaptivity of educational technology to the specific needs and developments of students' SRL. Consequently, it is possible to draw even more nuanced conclusions about how interviewees were talking about their SRL strategies and to what extent they might already use them, or what type of hurdles they encounter.</p> <p>Finally, when considering interviewees sentiment, they overwhelmingly used positive emotions and words associated with affective processes to describe their SRL strategies, as well as the feedback and the suggestions they got from the ALT (see Table 1).</p> <p>Table 1 Different feelings expressed by the respondents during the interviews</p> <p> <ephtml> <table frame="hsides" rules="groups"><thead><tr><th align="left" rowspan="2" /><th align="left" rowspan="2"><p>Affect</p></th><th align="left" rowspan="2"><p>Positive emotion</p></th><th align="left" colspan="4"><p>Negative emotion</p></th></tr><tr><th align="left"><p>Overall</p></th><th align="left"><p>Anxiety</p></th><th align="left"><p>Anger</p></th><th align="left"><p>Sad</p></th></tr></thead><tbody><tr><td align="left"><p>Mean</p></td><td char="," align="char"><p>5,62</p></td><td char="," align="char"><p>4,93</p></td><td char="," align="char"><p>0,71</p></td><td char="," align="char"><p>0,06</p></td><td char="," align="char"><p>0,06</p></td><td char="," align="char"><p>0,45</p></td></tr><tr><td align="left"><p>StDev</p></td><td char="," align="char"><p>4,70</p></td><td char="," align="char"><p>4,45</p></td><td char="," align="char"><p>1,64</p></td><td char="," align="char"><p>0,45</p></td><td char="," align="char"><p>0,41</p></td><td char="," align="char"><p>1,38</p></td></tr><tr><td align="left"><p>Min</p></td><td char="," align="char"><p>0,00</p></td><td char="," align="char"><p>0,00</p></td><td char="," align="char"><p>0,00</p></td><td char="," align="char"><p>0,00</p></td><td char="," align="char"><p>0,00</p></td><td char="," align="char"><p>0,00</p></td></tr><tr><td align="left"><p>Max</p></td><td char="," align="char"><p>26,67</p></td><td char="," align="char"><p>26,67</p></td><td char="," align="char"><p>12,50</p></td><td char="," align="char"><p>6,25</p></td><td char="," align="char"><p>4,00</p></td><td char="," align="char"><p>12,50</p></td></tr></tbody></table> </ephtml> </p> <p>These insights provide valuable information on whether being subjected to feedback and potentially new SRL strategies affect interviewees emotional disposition. In the case at hand, there does not seem to be cause for alarm. However, if the results would have been more pronounced, e.g., in terms of anxiety, the ALT could identify and highlight this, allowing it to respond with additional feedback and other forms of support to better help the interviewee in the situation.</p> <hd id="AN0178414888-16">Discussion</hd> <p>In this paper, our objective was to explore the potential of NLP as part of an ALT system to enhance real-time contextual adaptive learning and improve learners' SRL. Through the considerations around NLP, we aimed to examine the system's ability to interpret learner input and provide more effective responses.</p> <hd id="AN0178414888-17">Practical implications</hd> <p>Departing from our overarching research question we first investigated how an ALT can incorporate the needs and preferences of learners. In this context, we employed a co-design process, which enabled us to identify areas where studybuddy could be more responsive to the individual needs of learners. This collaborative approach allowed us to address the challenges of integrating educational technology into pedagogical practices while ensuring that the tool is customized to meet the specific needs of the school community and all learners involved. In doing so, we have endeavored to address the demand for educational technology to be more closely aligned with pedagogical practice (Kabudi et al., [<reflink idref="bib39" id="ref118">39</reflink>]; Zawacki-Richter et al., [<reflink idref="bib95" id="ref119">95</reflink>]; Zhang & Aslan, [<reflink idref="bib97" id="ref120">97</reflink>]). Regarding this, the possibility to analyze large amounts of data has demonstrated that promoting SRL through ALT systems offers the potential to counteract maladaptive SRL (Azevedo & Feyzi-Behnagh, [<reflink idref="bib5" id="ref121">5</reflink>]; Azevedo et al., [<reflink idref="bib7" id="ref122">7</reflink>]). Based on feedback from the co-design team, it became evident that there is a specific need to lower the threshold of use for users in the third phase of studybuddy development. The co-design group's feedback on studybuddy aligns with previous research indicating that poor usability leads to increased cognitive stress and more challenging learning experiences (Mirata et al., [<reflink idref="bib56" id="ref123">56</reflink>]). Consequently, we tested Deepgram, as an automatic transcription tool, to further lower the perceived hurdle in actively using studdybuddy as an ALT to support SRL. While we observed some inaccuracies in the automatic transcription, the integration of a speech recognition system holds promising possibilities to provide more immediate, just-in-time feedback based on students' verbal input.</p> <hd id="AN0178414888-18">Theoretical and methodological implications</hd> <p>Following our second research question we showcased a proof of concept on the potential of NLP to enhance ALT. We are thereby able to support the work of previous research on this topic, suggesting that the integration of NLP in ALT can support students' SRL strategies and scaffolding (Azevedo et al., 2022), as well as reveal and support the dynamic nature of SRL. We are also able to support previous studies that discovered that POS tagging enables a more detailed analysis of the grammatical structure of learners' contributions, leading to a better understanding of their learning process and providing more precise feedback based on language patterns (Nicoll et al., [<reflink idref="bib64" id="ref124">64</reflink>]). Additionally, employing opinion mining and sentiment analysis allows for the capture of emotional and motivational aspects of learners, facilitating tailored feedback on their SRL. Furthermore, we contribute to existing research by underlining the potential of NLP to potentially contribute to design a "warning system" that automatically flags when a student might be experiencing a difficult time (e.g., having stress or experiencing anxiety) (Macfadyen & Dawson, [<reflink idref="bib50" id="ref125">50</reflink>]). This opens avenues for gaining insights into learners' attitudes, engagement, and satisfaction, enabling feedback to be delivered in a timely and relevant manner (Nandakumar et al., [<reflink idref="bib62" id="ref126">62</reflink>]). To this end, we follow the work of other scholars that highlighted that NLP promises to be most beneficial, if it is complementary to qualitative methods, such as interviews (Cheligeer et al., [<reflink idref="bib21" id="ref127">21</reflink>]; Guetterman et al., [<reflink idref="bib36" id="ref128">36</reflink>]). Moreover, we contribute to a growing body of research that analyzes SRL processes through NLP in ALT without solely relying on self-reports (Winne & Perry, [<reflink idref="bib92" id="ref129">92</reflink>]) or traditional learning analytics data such as trace data (Schumacher & Ifenthaler, [<reflink idref="bib78" id="ref130">78</reflink>]).</p> <p>One of the main challenges that emerged in our study was the standardized questioning regarding different aspects of SRL, which significantly limited adaptivity for learners. However, integrating NLP provides evidence that the individual dimensions of SRL can be addressed in a more targeted manner. For instance, through POS tagging, it becomes feasible not only to explicitly address time management as a concept and provide appropriate feedback but also to comprehend words in their contextual meaning (e.g., my allocation of time instead of time management). Thus, the digital tool, in its current form, tackles a theory–practice issue by enabling the translation of everyday language into scientific terminology in a user-friendly manner (Garg et al., [<reflink idref="bib33" id="ref131">33</reflink>]). Ultimately, we demonstrated the feasibility of developing adaptive and portable systems that can be utilized in pedagogical practice and further refined in collaboration with pedagogical practitioners.</p> <hd id="AN0178414888-19">Future steps</hd> <p>Since we are still in the development phase of the digital tool, the question arises as to the next steps in our research project in order to address the identified limitations.</p> <p>Firstly, our study is based on a relatively small sample size. Once the digital tool has undergone the initial iteration process, it is important to test its effectiveness on a larger and more diverse sample. This will help in gaining a broader understanding of the tool's impact and its applicability across different contexts. Additionally, it raises the question of how teachers will access and effectively utilize the information generated by studybuddy in the classroom. Secondly, there is a need to expand the dictionaries used for NLP analyses (Berger & Packard, [<reflink idref="bib13" id="ref132">13</reflink>]; Fan et al., [<reflink idref="bib28" id="ref133">28</reflink>]). This expansion will enhance the accuracy and coverage of the NLP techniques employed, allowing for more comprehensive and nuanced analysis of learner input. Thirdly, the use of the speech recognition program requires further refinement. It is necessary to examine whether improved results can be achieved in the future by processing shorter text inputs without the need for manual verification. In our model of feedback processing (Fig. 8), the next steps in development are summarized as questions, which guide the subsequent stages of the research project. Moreover, Fig. 8 illustrates the integration of NLP into studybuddy.</p> <p></p> <ulist> <item> How are the prompts sent?</item> <p></p> <item> Studybuddy App</item> <p></p> <item> Studybuddy Website</item> <p></p> <item> How do learners communicate their current needs?</item> <p></p> <item> Voice Message</item> <p></p> </ulist> <p>• Written</p> <p></p> <ulist> <item> How is the information processed?</item> <p></p> <item> Dictation function</item> <p></p> <item> Automatic transcription</item> <p></p> <item> How is the information analyzed?</item> <p></p> <item> NLP synonyms</item> <p></p> <item> POS tagging</item> <p></p> <item> What happens with the analysis?</item> <p></p> <item> Adaptive, relevant SRL strategies for all learners</item> <p></p> <item> Feedback on learning behavior</item> <p></p> <item> Adjustments in the dashboard</item> <p></p> <item> What happens with it?</item> <p></p> <item> Hints are prompted to learners</item> <p></p> <item> SRL strategies are prompted to learners</item> <p></p> <item> What do learners do with it?</item> <p></p> <item> Adjust their SRL strategies</item> <p></p> <item> Provide feedback to the tool</item> <p></p> <item> Continuously collaborating with stakeholders to further develop the tool.</item> </ulist> <p>Graph: Fig. 8 Feedback loop of studybuddy 1.0</p> <p>In summary, the integration of NLP techniques into existing ALTs offers valuable data for in-depth analysis, enabling researchers and educators to gain deeper insights into learners' behaviors, preferences, and learning patterns. However, it is important to continue making further technical advancements, considering pedagogical implications, and gathering scientific evidence to ensure that these data are meaningful and beneficial for learners.</p> <hd id="AN0178414888-20">Funding</hd> <p>Open access funding provided by University of Bern.</p> <hd id="AN0178414888-21">Data availability</hd> <p>Data are available upon justified request after publication.</p> <hd id="AN0178414888-22">Supplementary Information</hd> <p>Below is the link to the electronic supplementary material.</p> <p>Graph: Supplementary file1 (PDF 102 KB)</p> <p>Graph: Supplementary file2 (PDF 70 KB)</p> <p>Graph: Supplementary file3 (PDF 465 KB)</p> <p>Graph: Supplementary file3 (PDF 1924 KB)</p> <hd id="AN0178414888-23">Publisher's Note</hd> <p>Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.</p> <ref id="AN0178414888-24"> <title> References </title> <blist> <bibl id="bib1" idref="ref46" type="bt">1</bibl> <bibtext> Aleven V, McLaughlin EA, Glenn RA, Koedinger KRMayer RE, Alexander P. Instruction based on adaptive learning technologies. Handbook of research on learning and instruction. 20172; Routledge: 522-560</bibtext> </blist> <blist> <bibl id="bib2" idref="ref4" type="bt">2</bibl> <bibtext> Anthonysamy L, Koo AC, Hew SH. Self-regulated learning strategies in higher education: Fostering digital literacy for sustainable lifelong learning. Education and Information Technologies. 2020; 25; 4: 2393-2414. 10.1007/s10639-020-10201-8</bibtext> </blist> <blist> <bibl id="bib3" idref="ref58" type="bt">3</bibl> <bibtext> Araka E, Oboko R, Maina E, Gitonga R. Using educational data mining techniques to identify profiles in self-regulated learning: An empirical evaluation. The International Review of Research in Open and Distributed Learning. 2022; 23; 1: 131-162. 10.19173/irrodl.v22i4.5401</bibtext> </blist> <blist> <bibl id="bib4" idref="ref51" type="bt">4</bibl> <bibtext> Azevedo R, Behnagh RF, Duffy M, Harley JM, Trevors GLand S, Jonassen D. Metacognition and self-regulated learning in student-centered learning environments. Theoretical foundations of learning environments. 20122; Routledge: 171-197</bibtext> </blist> <blist> <bibl id="bib5" idref="ref52" type="bt">5</bibl> <bibtext> Azevedo R, Feyzi-Behnagh R. Dysregulated learning with advanced learning technologies. Invited Papers. 2011; 7; 2: 9-18</bibtext> </blist> <blist> <bibl id="bib6" idref="ref12" type="bt">6</bibl> <bibtext> Azevedo R, Gašević D. Analyzing multimodal multichannel data about self-regulated learning with advanced learning technologies: Issues and challenges. Computers in Human Behavior. 2019; 96: 207-210. 10.1016/j.chb.2019.03.025</bibtext> </blist> <blist> <bibl id="bib7" idref="ref77" type="bt">7</bibl> <bibtext> Azevedo R, Taub M, Mudrick NVSchunk DH, Greene JA. Understanding and reasoning about real-time cognitive, affective, and metacognitive processes to foster self-regulation with advanced learning technologies. Handbook of self-regulation of learning and performance. 20172; Routledge: 254-270. 10.4324/9781315697048-17</bibtext> </blist> <blist> <bibl id="bib8" idref="ref114" type="bt">8</bibl> <bibtext> Baker RS, Inventado PSLarusson JA, White B. Educational data mining and learning analytics. Learning analytics: From Research to Practice. 2014; Springer: 61-75. 10.1007/978-1-4614-3305-7_4</bibtext> </blist> <blist> <bibl id="bib9" idref="ref65" type="bt">9</bibl> <bibtext> Becker, S. A, Brown, M, Dahlstrom, E, Davis, A, DePaul, K, Diaz, V, & Pomerantz, J. (2018). NMC horizon report: 2018 higher education edition. Educause. https://library.educause.edu/~/media/files/library/2018/8/2018horizonreport.pdf</bibtext> </blist> <blist> <bibtext> Beller Mvon Davier M, Gonzalez E, Kirsch I, Yamamoto K. Technologies in large-scale assessments: New directions, challenges, and opportunities. The Role of international large-scale assessments: Perspectives from technology, economy, and educational research. 2013; Springer: 25-45. 10.1007/978-94-007-4629-9_3</bibtext> </blist> <blist> <bibtext> Bellhäuser H, Liborius P, Schmitz B. Fostering self-regulated learning in online environments: Positive effects of a web-based training with peer feedback on learning behavior. Frontiers in Psychology. 2022; 13: 813381. 10.3389/fpsyg.2022.813381</bibtext> </blist> <blist> <bibtext> Benoit K, Watanabe K, Wang H, Nulty P, Obeng A, Müller S, Matsuo A. quanteda: An R package for the quantitative analysis of textual data. Journal of Open Source Software. 2018; 3; 30: 774-774. 10.21105/joss.00774</bibtext> </blist> <blist> <bibtext> Berger J, Packard G. Using natural language processing to understand people and culture. American Psychologist. 2022; 77; 4: 525-537. 10.1037/amp0000882</bibtext> </blist> <blist> <bibtext> Bodily R, Verbert K. Review of research on student-facing learning analytics dashboards and educational recommender systems. IEEE Transactions on Learning Technologies. 2017; 10; 4: 405-418. 10.1109/TLT.2017.2740172</bibtext> </blist> <blist> <bibtext> Bolhuis S. Towards process-oriented teaching for self-directed lifelong learning: A multidimensional perspective. Learning and Instruction. 2003; 13; 3: 327-347. 10.1016/S0959-4752(02)00008-7</bibtext> </blist> <blist> <bibtext> Boyd RL, Ashokkumar A, Seraj S, Pennebaker JW. The development and psychometric properties of LIWC-22. University of Texas at Austin. 2022. 10.13140/RG.2.2.23890.43205</bibtext> </blist> <blist> <bibtext> Broadbent J, Panadero E, Lodge JM, de Barba PBishop MJ, Boling E, Elen J, Svihla V. Technologies to enhance self-regulated learning in online and computer-mediated learning environments. Handbook of research in educational communications and technology. 2020; Springer: 37-52. 10.1007/978-3-030-36119-8_3</bibtext> </blist> <blist> <bibtext> Broadbent J, Poon WL. Self-regulated learning strategies & academic achievement in online higher education learning environments: A systematic review. The Internet and Higher Education. 2015; 27: 1-13. 10.1016/j.iheduc.2015.04.007</bibtext> </blist> <blist> <bibtext> Butler DL, Winne PH. Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research. 1995; 65; 3: 245-281. 10.2307/1170684</bibtext> </blist> <blist> <bibtext> Cavanagh T, Chen B, Lahcen RAM, Paradiso J. Constructing a design framework and pedagogical approach for adaptive learning in higher education: A practitioner's perspec-tive. The International Review of Research in Open and Distributed Learning. 2020; 21; 1: 172-196. 10.19173/irrodl.v21i1.4557</bibtext> </blist> <blist> <bibtext> Cheligeer, C, Yang, L, Nandi, T, Doktorchik, C, Quan, H, Zeng, Y, & Singh, S. (2022). Natural language processing (NLP) aided qualitative method in health research. Journal of Integrated Design and Process Science, Preprint, 1–18.</bibtext> </blist> <blist> <bibtext> Chen X, Xie H, Zou D, Hwang G-J. Application and theory gaps during the rise of artificial intelligence in education. Computers and Education: Artificial Intelligence. 2020; 1: 100002</bibtext> </blist> <blist> <bibtext> Chiche A, Yitagesu B. Part of speech tagging: A systematic review of deep learning and machine learning approaches. Journal of Big Data. 2022; 9; 1: 1-25. 10.1186/s40537-022-00561-y</bibtext> </blist> <blist> <bibtext> Credé M, Phillips LA. A meta-analytic review of the motivated strategies for learning questionnaire. Learning and Individual Differences. 2011; 21; 4: 337-346. 10.1016/j.lindif.2011.03.002</bibtext> </blist> <blist> <bibtext> Crossley S, Paquette L, Dascalu M, McNamara DS, Baker RS. Combining click-stream data with NLP tools to better understand MOOC completion. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, Doi. 2016; 10; 1145/2883851: 2883931</bibtext> </blist> <blist> <bibtext> Dabbagh N, Kitsantas A. Personal learning environments, social media, and self-regulated learning: A natural formula for connecting formal and informal learning. The Internet and Higher Education. 2012; 15; 1: 3-8. 10.1016/j.iheduc.2011.06.002</bibtext> </blist> <blist> <bibtext> Faber JM, Luyten H, Visscher AJ. The effects of a digital formative assessment tool on mathematics achievement and student motivation: Results of a randomized experiment. Computers & Education. 2017; 106: 83-96. 10.1016/j.compedu.2016.12.001</bibtext> </blist> <blist> <bibtext> Fan Y, Wen A, Shen F, Sohn S, Liu H, Wang L. Evaluating the impact of dictionary updates on automatic annotations based on clinical NLP systems. AMIA Summits on Translational Science Proceedings. 2019; 2019: 714-721</bibtext> </blist> <blist> <bibtext> Fong CJ, Krou MR, Johnston-Ashton K, Hoff MA, Lin S, Gonzales C. LASSI's great adventure: A meta-analysis of the learning and study strategies inventory and academic outcomes. Educational Research Review. 2021; 34: 100407. 10.1016/j.edurev.2021.100407</bibtext> </blist> <blist> <bibtext> Forsyth B, Kimble C, Birch J. Maximizing the adaptive learning technology experience. Journal of Higher Education Theory and Practice. 2016; 16; 4: 80-88</bibtext> </blist> <blist> <bibtext> Garcia R, Falkner K, Vivian R. Systematic literature review: Self-regulated learning strategies using e-learning tools for computer science. Computers & Education. 2018; 123: 150-163. 10.1016/j.compedu.2018.05.006</bibtext> </blist> <blist> <bibtext> Garcia I, Noguera I, Cortada-Pujol M. Students' perspective on participation in a co-design process of learning scenarios. The Journal of Educational Innovation, Partnership and Change. 2018. 10.21100/jeipc.v4i1.760</bibtext> </blist> <blist> <bibtext> Garg T, Masud S, Suresh T, Chakraborty T. Handling bias in toxic speech detection: A survey. ACM Computing Surveys. 2022. 10.1145/3580494</bibtext> </blist> <blist> <bibtext> Graesser A, McNamara D. Self-regulated learning in learning environments with pedagogical agents that interact in natural language. Educational Psychologist. 2010; 45; 4: 234-244. 10.1080/00461520.2010.515933</bibtext> </blist> <blist> <bibtext> Greene JA, Plumley RD, Urban CJ, Bernacki ML, Gates KM, Hogan KA, Demetriou C, Panter AT. Modeling temporal self-regulatory processing in a higher education biology course. Learning and Instruction. 2021; 72: 101201. 10.1016/j.learninstruc.2019.04.002</bibtext> </blist> <blist> <bibtext> Guetterman TC, Chang T, DeJonckheere M, Basu T, Scruggs E, Vydiswaran VV. Augmenting qualitative text analysis with natural language processing: Methodological study. Journal of Medical Internet Research. 2018; 20; 6: e231. 10.2196/jmir.9702</bibtext> </blist> <blist> <bibtext> Ifenthaler D, Schumacher C, Sahin M. System-based or teacher-based learning analytics feedback—What works best?. International Conference on Advanced Learning Technologies (ICALT). 2021; 2021: 184-186. 10.1109/ICALT52272.2021.00062</bibtext> </blist> <blist> <bibtext> Imhof C, Bergamin P, McGarrity SIsaias P, Sampson DG, Ifenthaler D. Implementation of adaptive learning systems: Current state and potential. Online teaching and learning in higher education. 20201; Springer: 93-115. 10.1007/978-3-030-48190-2_6</bibtext> </blist> <blist> <bibtext> Kabudi T, Pappas I, Olsen DH. AI-enabled adaptive learning systems: A systematic mapping of the literature. Computers and Education: Artificial Intelligence. 2021; 2: 100017. 10.1016/j.caeai.2021.100017</bibtext> </blist> <blist> <bibtext> Karlen Y, Hertel S, Hirt CN. Teachers' professional competences in self-regulated learning: An approach to integrate teachers' competences as self-regulated learners and as agents of self-regulated learning in a holistic manner. Frontiers in Education. 2020; 5: 159. 10.3389/feduc.2020.00159</bibtext> </blist> <blist> <bibtext> Kerr P. Adaptive learning. ELT Journal. 2016; 70; 1: 88-93. 10.1093/elt/ccv055</bibtext> </blist> <blist> <bibtext> Khan W, Daud A, Khan K, Nasir JA, Basheri M, Aljohani N, Alotaibi FS. Part of speech tagging in urdu: Comparison of machine and deep learning approaches. IEEE Access. 2019; 7: 38918-38936. 10.1109/ACCESS.2019.2897327</bibtext> </blist> <blist> <bibtext> Klug J, Ogrin S, Keller S, Ihringer A, Schmitz B. A plea for self-regulated learning as a process: Modelling, measuring and intervening. Psychological Test and Assessment Modeling. 2011; 53; 1: 51-72</bibtext> </blist> <blist> <bibtext> Könings KD, Brand-Gruwel S, Van Merriënboer JJG. Participatory instructional redesign by students and teachers in secondary education: Effects on perceptions of instruction. Instructional Science. 2011; 39; 5: 737-762. 10.1007/s11251-010-9152-3</bibtext> </blist> <blist> <bibtext> Kuckartz, U, & Rädiker, S. (2019). Analyzing qualitative data with MAXQDA: Text, audio, and video. Springer. https://doi.org/10.1007/978-3-030-15671-8</bibtext> </blist> <blist> <bibtext> Kurilovas E, Zilinskiene I, Dagiene V. Recommending suitable learning paths according to learners' preferences: Experimental research results. Computers in Human Behavior. 2015; 51: 945-951. 10.1016/j.chb.2014.10.027</bibtext> </blist> <blist> <bibtext> Lahitani, A. R, Permanasari, A. E, & Setiawan, N. A. (2016). Cosine similarity to determine similarity measure: Study case in online essay assessment. 2016 4th International Conference on Cyber and IT Service Management, 1–6.</bibtext> </blist> <blist> <bibtext> Liu BIndurkhya N, Damerau FJ. Sentiment analysis and subjectivity. Handbook of natural language processing. 20102; Routledge: 627-666</bibtext> </blist> <blist> <bibtext> Lüftenegger M, Schober B, van de Schoot R, Wagner P, Finsterwald M, Spiel C. Lifelong learning as a goal—Do autonomy and self-regulation in school result in well prepared pupils?. Learning and Instruction. 2012; 22; 1: 27-36. 10.1016/j.learninstruc.2011.06.001</bibtext> </blist> <blist> <bibtext> Macfadyen LP, Dawson S. Mining LMS data to develop an "early warning system" for educators: A proof of concept. Computers & Education. 2010; 54; 2: 588-599. 10.1016/j.compedu.2009.09.008</bibtext> </blist> <blist> <bibtext> Manning C, Schutze H. Foundations of statistical natural language processing. 1999; MIT press</bibtext> </blist> <blist> <bibtext> Martin F, Chen Y, Moore RL, Westine CD. Systematic review of adaptive learning research designs, context, strategies, and technologies from 2009 to 2018. Educational Technology Research and Development. 2020; 68; 4: 1903-1929. 10.1007/s11423-020-09793-2</bibtext> </blist> <blist> <bibtext> McKercher KA. Beyond Sticky Notes Mindsets, methods & movements. 2020; PublishDrive</bibtext> </blist> <blist> <bibtext> Mejeh, M, Sarbach, L. & Hascher, T. (in press). Effects of adaptive feedback through a digital tool—A mixed-methods study on the course of self-regulated learning. Education and Information Technologies.</bibtext> </blist> <blist> <bibtext> Metzger, C. (2017). Lern- und Arbeitsstrategien: Ein Fachbuch für Studierende [Learning and Working Strategies: A Reference Book for Students]. Cornelsen.</bibtext> </blist> <blist> <bibtext> Mirata V, Hirt F, Bergamin P, Van Der Westhuizen C. Challenges and contexts in establishing adaptive learning in higher education: Findings from a Delphi study. International Journal of Educational Technology in Higher Education. 2020; 17; 1: 32. 10.1186/s41239-020-00209-y</bibtext> </blist> <blist> <bibtext> Molenaar I, Horvers A, Baker RS. What can moment-by-moment learning curves tell about students' self-regulated learning?. Learning and Instruction. 2021; 72: 101206. 10.1016/j.learninstruc.2019.05.003</bibtext> </blist> <blist> <bibtext> Molenaar I, Van Campen CK. Learning analytics in practice: The effects of adaptive educational technology Snappet on students' arithmetic skills. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge - LAK. 2016; 16: 538-539. 10.1145/2883851.2883892</bibtext> </blist> <blist> <bibtext> Moreno-Guerrero A-J, López-Belmonte J, Marín-Marín J-A, Soler-Costa R. Scientific development of educational artificial intelligence in web of science. Future Internet. 2020; 12; 8: 124. 10.3390/fi12080124</bibtext> </blist> <blist> <bibtext> Mousavinasab E, Zarifsanaiey N, NiakanKalhori SR, Rakhshan M, Keikha L, Ghazi Saeedi M. Intelligent tutoring systems: A systematic review of characteristics, applications, and evaluation methods. Interactive Learning Environments. 2021; 29; 1: 142-163. 10.1080/10494820.2018.1558257</bibtext> </blist> <blist> <bibtext> Nakic J, Granic A, Glavinic V. Anatomy of student models in adaptive learning systems: A systematic literature review of individual differences from 2001 to 2013. Journal of Educational Computing Research. 2015; 51; 4: 459-489. 10.2190/EC.51.4.e</bibtext> </blist> <blist> <bibtext> Nandakumar R, Pallavi MS, Pramath PH, Vinayak H. Sentimental analysis on student feedback using NLP & POS tagging. International Conference on Edge Computing and Applications (ICECAA). 2022; 2022: 309-313. 10.1109/ICECAA55415.2022.9936569</bibtext> </blist> <blist> <bibtext> Nicol DJ, Macfarlane-Dick D. Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education. 2006; 31; 2: 199-218. 10.1080/03075070600572090</bibtext> </blist> <blist> <bibtext> Nicoll S, Douglas K, Brinton C. Giving feedback on feedback: An assessment of grader feedback construction on student performance. LAK22: 12th International Learning Analytics and Knowledge Conference, Doi. 2022; 10; 1145/3506860: 3506897</bibtext> </blist> <blist> <bibtext> OECD. Trends shaping education 2022. OECD. 2022. 10.1787/6ae8771a-en</bibtext> </blist> <blist> <bibtext> Park E, Ifenthaler D, Clariana RB. Adaptive or adapted to: Sequence and reflexive thematic analysis to understand learners' self-regulated learning in an adaptive learning analytics dashboard. British Journal of Educational Technology. 2023; 54; 1: 98-125. 10.1111/bjet.13287</bibtext> </blist> <blist> <bibtext> Pelletier, K. (2022). 2022 Educause horizon report: Teaching and learning edition. Educause. https://library.educause.edu/-/media/files/library/2022/4/2022hrteachinglearning.pdf?la=en&hash=6F6B51DFF485A06DF6BDA8F88A0894EF9938D50B</bibtext> </blist> <blist> <bibtext> Penuel WR, Allen A-R, Henson K, Campanella M, Patton R, Rademaker K, Reed W, Watkins D, Wingert K, Reiser B, Zivic A. Learning practical design knowledge through co-designing storyline science curriculum units. Cognition and Instruction. 2022; 40; 1: 148-170. 10.1080/07370008.2021.2010207</bibtext> </blist> <blist> <bibtext> Penuel WR, Roschelle J, Shechtman N. Designing formative assessment software with teachers: An analysis of the co-design process. Research and Practice in Technology Enhanced Learning. 2007; 2; 1: 51-74. 10.1142/S1793206807000300</bibtext> </blist> <blist> <bibtext> Petersen AK, Christiansen RB, Gynther K. Changing paradigms: From schooling to schools as adaptive recommendation systems. Universal Journal of Educational Research. 2017; 5; 11: 2081-2091. 10.13189/ujer.2017.051125</bibtext> </blist> <blist> <bibtext> Raković M, Bernacki ML, Greene JA, Plumley RD, Hogan KA, Gates KM, Panter AT. Examining the critical role of evaluation and adaptation in self-regulated learning. Contemporary Educational Psychology. 2022; 68: 102027. 10.1016/j.cedpsych.2021.102027</bibtext> </blist> <blist> <bibtext> Raković M, Winne PH, Marzouk Z, Chang D. Automatic identification of knowledge-transforming content in argument essays developed from multiple sources. Journal of Computer Assisted Learning. 2021; 37; 4: 903-924. 10.1111/jcal.12531</bibtext> </blist> <blist> <bibtext> Robinson OC. Sampling in interview-based qualitative research: A theoretical and practical guide. Qualitative Research in Psychology. 2014; 11; 1: 25-41. 10.1080/14780887.2013.801543</bibtext> </blist> <blist> <bibtext> Rosenthal, S, Farra, N, & Nakov, P. (2017). SemEval-2017 task 4: Sentiment analysis in Twitter. Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), 502–518. https://doi.org/10.18653/v1/S17-2088.</bibtext> </blist> <blist> <bibtext> Sáiz-Manzanares MC, Marticorena-Sánchez R, Martín-Antón LJ, Díez IG, Almeida L. Perceived satisfaction of university students with the use of chatbots as a tool for self-regulated learning. Heliyon. 2023; 9; 1: e12843. 10.1016/j.heliyon.2023.e12843</bibtext> </blist> <blist> <bibtext> Scherer R, Siddiq F, Tondeur J. The Technology Acceptance Model (TAM): A meta-analytic structural equation modeling approach to explaining teachers' adoption of digital technology in education. Computers & Education. 2019; 128: 13-35. 10.1016/j.compedu.2018.09.009</bibtext> </blist> <blist> <bibtext> Schmid R, Pauli C, Stebler R, Reusser K, Petko D. Implementation of technology-supported personalized learning—It's impact on instructional quality. The Journal of Educational Research. 2022; 115; 3: 187-198. 10.1080/00220671.2022.2089086</bibtext> </blist> <blist> <bibtext> Schumacher C, Ifenthaler D. Features students really expect from learning analytics. Computers in Human Behavior. 2018; 78: 397-407. 10.1016/j.chb.2017.06.030</bibtext> </blist> <blist> <bibtext> Seiler L, Kuhnel M, Honal A, Ifenthaler Dde Witt C, Gloerfeld C. Mobile Learning Analytics: Potenziale für Lernen und Lehren am Beispiel Hochschule [Mobile Learning Analytics: Potentials for Learning and Teaching at the Example of a University]. Handbuch Mobile Learning. 2018; Springer: 585-608. 10.1007/978-3-658-19123-8_29</bibtext> </blist> <blist> <bibtext> Shute VJ. Focus on formative feedback. Review of Educational Research. 2008; 78; 1: 153-189. 10.3102/0034654307313795</bibtext> </blist> <blist> <bibtext> Taranto D, Buchanan MT. Sustaining lifelong learning: A self-regulated learning (SRL) approach. Discourse and Communication for Sustainable Education. 2020; 11; 1: 5-15. 10.2478/dcse-2020-0002</bibtext> </blist> <blist> <bibtext> Tempelaar D. Supporting the less-adaptive student: The role of learning analytics, formative assessment and blended learning. Assessment & Evaluation in Higher Education. 2020; 45; 4: 579-593. 10.1080/02602938.2019.1677855</bibtext> </blist> <blist> <bibtext> UNESCO Institute for Lifelong Learning. (2022). Lifelong learning opportunities for all: Medium-term strategy 2022–2029. UNESCO Institute for Lifelong Learning. https://unesdoc.unesco.org/ark:/48223/pf0000380778</bibtext> </blist> <blist> <bibtext> van Beek JA, de Jong FPCM, Minnaert AEMG, Wubbels T. Teacher practice in secondary vocational education: Between teacher-regulated activities of student learning and student self-regulation. Teaching and Teacher Education. 2014; 40: 1-9. 10.1016/j.tate.2014.01.005</bibtext> </blist> <blist> <bibtext> van de Pol J, Volman M, Beishuizen J. Scaffolding in teacher-student interaction: A decade of research. Educational Psychology Review. 2010; 22; 3: 271-296. 10.1007/s10648-010-9127-6</bibtext> </blist> <blist> <bibtext> Varathan KD, Giachanou A, Crestani F. Comparative opinion mining: A review. Journal of the Association for Information Science and Technology. 2017; 68; 4: 811-829. 10.1002/asi.23716</bibtext> </blist> <blist> <bibtext> Weinstein CE, Zimmermann SA, Palmer DRWeinstein CE, Goetz ET, Alexander PA. Assessing Learning Strategies: The Design and Development of the LASSI. Learning and Study Strategies. 1988; Academic Press: 25-40. 10.1016/B978-0-12-742460-6.50009-8</bibtext> </blist> <blist> <bibtext> Wigfield A, Klauda SL, Cambria JZimmerman BJ, Schunk DH. Influences on the development of academic self-regulatory processes. Handbook of self-regulation of learning and performance. 2011; Routledge: 33-48. 10.4324/9780203839010.ch3</bibtext> </blist> <blist> <bibtext> Winne PH. Leveraging big data to help each learner and accelerate learning science. Teachers College Record. 2017; 119; 3: 1-24. 10.1177/016146811711900305</bibtext> </blist> <blist> <bibtext> Winne PH, Azevedo RSawyer RK. Metacognition. The Cambridge handbook of the learning sciences. 20142; Cambridge University Press: 63-87. 10.1017/CBO9781139519526.006</bibtext> </blist> <blist> <bibtext> Winne PH, Hadwin AFHacker DJ, Dunlosky J, Greasser AC. Studying as self-regulated learning. Metacognition in educational theory and practice. 19981; Routledge: 277-304</bibtext> </blist> <blist> <bibtext> Winne PH, Perry NEBoekaerts M, Pintrich PR, Zeidner M. Measuring self-regulated learning. Handbook of self-regulation. 20001; Elsevier: 531-566. 10.1016/B978-012109890-2/50045-7</bibtext> </blist> <blist> <bibtext> Wild K-P, Schiefele U. Lernstrategien im Studium: Ergebnisse zur Faktorenstruktur und Reliabilität eines neuen Fragebogens [Learning strategies in college: Results on the factor structure and reliability of a new questionnaire]. Zeitschrift Für Differentielle Und Diagnostische Psychologie. 1994; 15: 185-200</bibtext> </blist> <blist> <bibtext> Xie H, Chu H-C, Hwang G-J, Wang C-C. Trends and development in technology-enhanced adaptive/personalized learning: A systematic review of journal publications from 2007 to 2017. Computers & Education. 2019; 140: 103599. 10.1016/j.compedu.2019.103599</bibtext> </blist> <blist> <bibtext> Zawacki-Richter O, Marín VI, Bond M, Gouverneur F. Systematic review of research on artificial intelligence applications in higher education—Where are the educators?. International Journal of Educational Technology in Higher Education. 2019; 16; 1: 39. 10.1186/s41239-019-0171-0</bibtext> </blist> <blist> <bibtext> Zeman, D, Popel, M, Straka, M, Hajič, j, Nivre, j, Ginter, F, Luotolahti, J, Pyysalo, S, Petrov, S, Potthast, M, Tyers, F, Badmaeva, E, Gokirmak, M, Nedoluzhko, A, Cinková, S, Hajič jr, J, Hlaváčová, J, Kettnerová, V, Urešová, Z, et al. (2017). CoNLL 2017 shared task: Multilingual parsing from raw text to universal dependencies. Proceedings of the CoNLL 2017 shared task: Multilingual parsing from raw text to universal dependencies (pp. 1–19). Association for Computational Linguistics. https://aclanthology.org/K17-3001v2.pdf</bibtext> </blist> <blist> <bibtext> Zhang K, Aslan AB. AI technologies for education: Recent research & future directions. Computers and Education. 2021; 2: 100025. 10.1016/j.caeai.2021.100025</bibtext> </blist> </ref> <aug> <p>By Mathias Mejeh and Martin Rehm</p> <p>Reported by Author; Author</p> <p></p> <p>Mathias Mejeh is a senior scientist at the Institute for Educational Science at the University of Bern (Switzerland), as well as visiting scholar at the University of California, San Diego (USA). His main research interests are self- and co-regulated learning, inclusive education, vocational education, mixed-methods-research and social network analysis.</p> <p>Martin Rehm is an educational science post-doc at the University of Regensburg (Germany), as well as the University of California, San Diego (USA). His main research interests are informal learning on social media, social capital in online opportunity spaces, mixed-methods, social network analysis, and computational linguistics.</p> </aug> <nolink nlid="nl1" bibid="bib65" firstref="ref1"></nolink> <nolink nlid="nl2" bibid="bib15" firstref="ref2"></nolink> <nolink nlid="nl3" bibid="bib83" firstref="ref3"></nolink> <nolink nlid="nl4" bibid="bib49" firstref="ref5"></nolink> <nolink nlid="nl5" bibid="bib81" firstref="ref6"></nolink> <nolink nlid="nl6" bibid="bib88" firstref="ref7"></nolink> <nolink nlid="nl7" bibid="bib10" firstref="ref8"></nolink> <nolink nlid="nl8" bibid="bib76" firstref="ref9"></nolink> <nolink nlid="nl9" bibid="bib18" firstref="ref10"></nolink> <nolink nlid="nl10" bibid="bib17" firstref="ref11"></nolink> <nolink nlid="nl11" bibid="bib52" firstref="ref13"></nolink> <nolink nlid="nl12" bibid="bib57" firstref="ref15"></nolink> <nolink nlid="nl13" bibid="bib22" firstref="ref17"></nolink> <nolink nlid="nl14" bibid="bib95" firstref="ref18"></nolink> <nolink nlid="nl15" bibid="bib21" firstref="ref19"></nolink> <nolink nlid="nl16" bibid="bib36" firstref="ref20"></nolink> <nolink nlid="nl17" bibid="bib38" firstref="ref21"></nolink> <nolink nlid="nl18" bibid="bib46" firstref="ref22"></nolink> <nolink nlid="nl19" bibid="bib61" firstref="ref23"></nolink> <nolink nlid="nl20" bibid="bib67" firstref="ref24"></nolink> <nolink nlid="nl21" bibid="bib41" firstref="ref25"></nolink> <nolink nlid="nl22" bibid="bib70" firstref="ref26"></nolink> <nolink nlid="nl23" bibid="bib94" firstref="ref27"></nolink> <nolink nlid="nl24" bibid="bib77" firstref="ref28"></nolink> <nolink nlid="nl25" bibid="bib35" firstref="ref32"></nolink> <nolink nlid="nl26" bibid="bib19" firstref="ref33"></nolink> <nolink nlid="nl27" bibid="bib40" firstref="ref34"></nolink> <nolink nlid="nl28" bibid="bib43" firstref="ref35"></nolink> <nolink nlid="nl29" bibid="bib63" firstref="ref36"></nolink> <nolink nlid="nl30" bibid="bib82" firstref="ref37"></nolink> <nolink nlid="nl31" bibid="bib84" firstref="ref38"></nolink> <nolink nlid="nl32" bibid="bib85" firstref="ref39"></nolink> <nolink nlid="nl33" bibid="bib66" firstref="ref40"></nolink> <nolink nlid="nl34" bibid="bib89" firstref="ref41"></nolink> <nolink nlid="nl35" bibid="bib90" firstref="ref43"></nolink> <nolink nlid="nl36" bibid="bib91" firstref="ref44"></nolink> <nolink nlid="nl37" bibid="bib58" firstref="ref47"></nolink> <nolink nlid="nl38" bibid="bib30" firstref="ref48"></nolink> <nolink nlid="nl39" bibid="bib27" firstref="ref49"></nolink> <nolink nlid="nl40" bibid="bib25" firstref="ref55"></nolink> <nolink nlid="nl41" bibid="bib72" firstref="ref56"></nolink> <nolink nlid="nl42" bibid="bib34" firstref="ref57"></nolink> <nolink nlid="nl43" bibid="bib75" firstref="ref59"></nolink> <nolink nlid="nl44" bibid="bib71" firstref="ref62"></nolink> <nolink nlid="nl45" bibid="bib48" firstref="ref63"></nolink> <nolink nlid="nl46" bibid="bib23" firstref="ref64"></nolink> <nolink nlid="nl47" bibid="bib59" firstref="ref66"></nolink> <nolink nlid="nl48" bibid="bib60" firstref="ref67"></nolink> <nolink nlid="nl49" bibid="bib97" firstref="ref68"></nolink> <nolink nlid="nl50" bibid="bib20" firstref="ref70"></nolink> <nolink nlid="nl51" bibid="bib39" firstref="ref72"></nolink> <nolink nlid="nl52" bibid="bib69" firstref="ref78"></nolink> <nolink nlid="nl53" bibid="bib68" firstref="ref79"></nolink> <nolink nlid="nl54" bibid="bib53" firstref="ref80"></nolink> <nolink nlid="nl55" bibid="bib73" firstref="ref81"></nolink> <nolink nlid="nl56" bibid="bib31" firstref="ref83"></nolink> <nolink nlid="nl57" bibid="bib32" firstref="ref84"></nolink> <nolink nlid="nl58" bibid="bib44" firstref="ref85"></nolink> <nolink nlid="nl59" bibid="bib45" firstref="ref86"></nolink> <nolink nlid="nl60" bibid="bib86" firstref="ref89"></nolink> <nolink nlid="nl61" bibid="bib24" firstref="ref90"></nolink> <nolink nlid="nl62" bibid="bib29" firstref="ref91"></nolink> <nolink nlid="nl63" bibid="bib93" firstref="ref92"></nolink> <nolink nlid="nl64" bibid="bib55" firstref="ref93"></nolink> <nolink nlid="nl65" bibid="bib47" firstref="ref94"></nolink> <nolink nlid="nl66" bibid="bib42" firstref="ref97"></nolink> <nolink nlid="nl67" bibid="bib96" firstref="ref98"></nolink> <nolink nlid="nl68" bibid="bib12" firstref="ref99"></nolink> <nolink nlid="nl69" bibid="bib51" firstref="ref101"></nolink> <nolink nlid="nl70" bibid="bib74" firstref="ref102"></nolink> <nolink nlid="nl71" bibid="bib16" firstref="ref103"></nolink> <nolink nlid="nl72" bibid="bib11" firstref="ref105"></nolink> <nolink nlid="nl73" bibid="bib26" firstref="ref107"></nolink> <nolink nlid="nl74" bibid="bib80" firstref="ref108"></nolink> <nolink nlid="nl75" bibid="bib79" firstref="ref109"></nolink> <nolink nlid="nl76" bibid="bib14" firstref="ref110"></nolink> <nolink nlid="nl77" bibid="bib37" firstref="ref111"></nolink> <nolink nlid="nl78" bibid="bib87" firstref="ref117"></nolink> <nolink nlid="nl79" bibid="bib56" firstref="ref123"></nolink> <nolink nlid="nl80" bibid="bib64" firstref="ref124"></nolink> <nolink nlid="nl81" bibid="bib50" firstref="ref125"></nolink> <nolink nlid="nl82" bibid="bib62" firstref="ref126"></nolink> <nolink nlid="nl83" bibid="bib92" firstref="ref129"></nolink> <nolink nlid="nl84" bibid="bib78" firstref="ref130"></nolink> <nolink nlid="nl85" bibid="bib33" firstref="ref131"></nolink> <nolink nlid="nl86" bibid="bib13" firstref="ref132"></nolink> <nolink nlid="nl87" bibid="bib28" firstref="ref133"></nolink>
Header DbId: eric
DbLabel: ERIC
An: EJ1430623
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Taking Adaptive Learning in Educational Settings to the Next Level: Leveraging Natural Language Processing for Improved Personalization
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Mathias+Mejeh%22">Mathias Mejeh</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0003-4923-8936">0000-0003-4923-8936</externalLink>)<br /><searchLink fieldCode="AR" term="%22Martin+Rehm%22">Martin Rehm</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Educational+Technology+Research+and+Development%22"><i>Educational Technology Research and Development</i></searchLink>. 2024 72(3):1597-1621.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 25
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22High+Schools%22">High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Educational+Environment%22">Educational Environment</searchLink><br /><searchLink fieldCode="DE" term="%22Natural+Language+Processing%22">Natural Language Processing</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Technology%22">Educational Technology</searchLink><br /><searchLink fieldCode="DE" term="%22High+School+Students%22">High School Students</searchLink><br /><searchLink fieldCode="DE" term="%22High+School+Teachers%22">High School Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Needs%22">Student Needs</searchLink><br /><searchLink fieldCode="DE" term="%22Design+Requirements%22">Design Requirements</searchLink><br /><searchLink fieldCode="DE" term="%22Design%22">Design</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Cooperation%22">Educational Cooperation</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Researchers%22">Educational Researchers</searchLink><br /><searchLink fieldCode="DE" term="%22Partnerships+in+Education%22">Partnerships in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Individualized+Instruction%22">Individualized Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Self+Management%22">Self Management</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s11423-024-10345-1
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1042-1629<br />1556-6501
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Educational technology plays an increasingly significant role in supporting Self-Regulated Learning (SRL), while the importance of Adaptive Learning Technology (ALT) grows due to its ability to provide personalized support for learners. Despite recognizing the potential of ALT to be influential in SRL, effectively addressing pedagogical concerns about using ALT to enhance students' SRL remains an ongoing challenge. Consequently, learners can develop perceptions that ALT is not customized to their specific needs, resulting in critical or dismissive attitudes towards such systems. This study therefore explores the potential of combining Natural Language Processing (NLP) to enhance real-time contextual adaptive learning within an ALT to support learners' SRL. In addressing this question, our approach consisted of two steps. Initially, we focused on developing an ALT that incorporates learners' needs. Subsequently, we explored the potential of NLP to capture pertinent learner information essential for providing adaptive support in SRL. In order to ensure direct applicability to pedagogical practice, we engaged in a one-year co-design phase with a high school. Qualitative data was collected to evaluate the implementation of the ALT and to check complementary possibilities to enhance SRL by potentially adding NLP. Our findings indicate that the learning technology we developed has been well-received and implemented in practice. However, there is potential for further development, particularly in terms of providing adaptive support for students. It is evident that a meaningful integration of NLP and ALT holds substantial promise for future enhancements, enabling sustainable support for learners SRL.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1430623
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1430623
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s11423-024-10345-1
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 25
        StartPage: 1597
    Subjects:
      – SubjectFull: Educational Environment
        Type: general
      – SubjectFull: Natural Language Processing
        Type: general
      – SubjectFull: Educational Technology
        Type: general
      – SubjectFull: High School Students
        Type: general
      – SubjectFull: High School Teachers
        Type: general
      – SubjectFull: Student Needs
        Type: general
      – SubjectFull: Design Requirements
        Type: general
      – SubjectFull: Design
        Type: general
      – SubjectFull: Educational Cooperation
        Type: general
      – SubjectFull: Educational Researchers
        Type: general
      – SubjectFull: Partnerships in Education
        Type: general
      – SubjectFull: Technology Uses in Education
        Type: general
      – SubjectFull: Individualized Instruction
        Type: general
      – SubjectFull: Self Management
        Type: general
    Titles:
      – TitleFull: Taking Adaptive Learning in Educational Settings to the Next Level: Leveraging Natural Language Processing for Improved Personalization
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Mathias Mejeh
      – PersonEntity:
          Name:
            NameFull: Martin Rehm
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 1042-1629
            – Type: issn-electronic
              Value: 1556-6501
          Numbering:
            – Type: volume
              Value: 72
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Educational Technology Research and Development
              Type: main
ResultId 1