Building Reading Comprehension and Knowledge with iSTART: An ITS to Provide Formative Feedback in Reading Instruction

Saved in:
Bibliographic Details
Title: Building Reading Comprehension and Knowledge with iSTART: An ITS to Provide Formative Feedback in Reading Instruction
Language: English
Authors: Micah Watanabe (ORCID 0000-0002-9929-6600), Megan Imundo (ORCID 0000-0003-4599-4777), Katerina Christhilf (ORCID 0000-0003-3901-8665), Tracy Arner (ORCID 0000-0002-5072-8636), Danielle S. McNamara (ORCID 0000-0001-5869-1420)
Source: Grantee Submission. 2024.
Peer Reviewed: Y
Page Count: 5
Publication Date: 2024
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R305N210041
Document Type: Speeches/Meeting Papers
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Reading Comprehension, Reading Strategies, Intelligent Tutoring Systems, Reading Instruction, Scores, Instructional Effectiveness, Undergraduate Students, Electronic Learning, Computer Assisted Instruction, Reading Tests
Assessment and Survey Identifiers: Gates MacGinitie Reading Tests
Abstract: Reading comprehension is essential for students' ability to build knowledge. Students' comprehension abilities can be enhanced by providing students with deliberate practice and formative feedback on reading comprehension strategies. iSTART is an Intelligent Tutoring System (ITS) that is designed to provide instruction in reading strategies with minimal teacher supervision -- affording the ability to teach reading strategies at scale. In the current study, undergraduate students received reading strategy instruction and opportunities for deliberate practice via the iSTART intelligent tutoring system or not (i.e., no-treatment control group). Participants' reading comprehension and psychology knowledge were assessed. The iSTART group demonstrated substantially greater scores than the control group on a post-training reading comprehension measure (Cohen's d > 1.0). The average psychology knowledge scores did not differ between iSTART (post-training) and control groups, but overall these scores were unexpectedly low. Within the iSTART group, there was no difference in reading comprehension and knowledge scores as a function of students' different behaviors in the system. Overall, the results indicate that iSTART is an effective tool to teach reading strategies at large scale. However, further work is required to test the extent to which iSTART supports knowledge building. [This paper was published in: "Proceedings of Learning @ Scale conference (L@S '24)," ACM, 2024.]
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2024
Accession Number: ED655791
Database: ERIC
Description
Abstract:Reading comprehension is essential for students' ability to build knowledge. Students' comprehension abilities can be enhanced by providing students with deliberate practice and formative feedback on reading comprehension strategies. iSTART is an Intelligent Tutoring System (ITS) that is designed to provide instruction in reading strategies with minimal teacher supervision -- affording the ability to teach reading strategies at scale. In the current study, undergraduate students received reading strategy instruction and opportunities for deliberate practice via the iSTART intelligent tutoring system or not (i.e., no-treatment control group). Participants' reading comprehension and psychology knowledge were assessed. The iSTART group demonstrated substantially greater scores than the control group on a post-training reading comprehension measure (Cohen's d > 1.0). The average psychology knowledge scores did not differ between iSTART (post-training) and control groups, but overall these scores were unexpectedly low. Within the iSTART group, there was no difference in reading comprehension and knowledge scores as a function of students' different behaviors in the system. Overall, the results indicate that iSTART is an effective tool to teach reading strategies at large scale. However, further work is required to test the extent to which iSTART supports knowledge building. [This paper was published in: "Proceedings of Learning @ Scale conference (L@S '24)," ACM, 2024.]