View in EDS HTML Full Text PDF Full Text

Graph Out Loud: Pre-Service Teachers' Data Decisions and Interpretations of CBM Progress Graphs

Saved in:
Bibliographic Details
Title: Graph Out Loud: Pre-Service Teachers' Data Decisions and Interpretations of CBM Progress Graphs
Language: English
Authors: Jessica R. Toste (ORCID 0000-0002-6327-0054), Marissa J. Filderman, Nathan H. Clemens (ORCID 0000-0002-8361-1303), Erica Fry (ORCID 0009-0008-9393-1408)
Source: Journal of Learning Disabilities. 2025 58(1):33-45.
Availability: SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Peer Reviewed: Y
Page Count: 13
Publication Date: 2025
Sponsoring Agency: Institute of Education Sciences (ED)
Contract Number: R324A190126
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Preservice Teachers, Data Use, Decision Making, Progress Monitoring, Visual Aids, Special Education Teachers, Teaching Methods, Measurement Techniques, Protocol Analysis, Verbal Communication, Reading Difficulties
Geographic Terms: Texas, Oregon, Pennsylvania, Virginia
DOI: 10.1177/00222194241231768
ISSN: 0022-2194
1538-4780
Abstract: Data-based instruction (DBI) is a process in which teachers use progress data to make ongoing instructional decisions for students with learning disabilities. Curriculum-based measurement (CBM) is a common form of progress monitoring, and CBM data are placed on a graph to guide decision-making. Despite the central role that graph interpretation plays in the successful implementation of DBI, relatively little attention has been devoted to investigating this skill among special education teachers. In the present study, we examined the data decisions of 32 U.S. pre-service special education teachers (29 females and 3 males). Participants viewed data presented sequentially on CBM progress graphs and used a think-aloud procedure to explain their reasoning each time they indicated they would make instructional changes. We also asked participants to make the same type of decisions in response to static CBM progress graphs depicting 10 weeks of data. Overall, there was inconsistency in pre-service teachers' responses related to "when" or "why" they would make an instructional change. Decisions were often influenced by graph-related features, such as variability in the data. Furthermore, responses suggested misunderstandings that led to premature instructional change decisions and reliance on individual data points.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2024
Accession Number: EJ1453775
Database: ERIC
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwHjsZsonQPnAjJLCvyWmVsMAAAA4TCB3gYJKoZIhvcNAQcGoIHQMIHNAgEAMIHHBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDKbWvuhbLJDX_Mi06gIBEICBmTLZa4IiuzaKQzuPYnbKaqFH9J0bVViXze7XNkOxX1shn3Ho7lL65Smc_WAAJ9GkTsIWE0rX5PJmelx6PdLeQ61uQbbZ6ozlHw_kgDiPY4SncUQlM1Ss3-abtRYdS-E9qrZ6b8A8F8kdH9IhDFtXyT7-LmtxakWHUryUpv7LWyNHB9uYO2mkuVJDmoCUsuaogVtaUZjCt9vtKQ==
Text:
  Availability: 1
  Value: <anid>AN0181621033;led01jan.25;2024Dec19.00:27;v2.2.500</anid> <title id="AN0181621033-1">Graph Out Loud: Pre-Service Teachers' Data Decisions and Interpretations of CBM Progress Graphs </title> <p>Data-based instruction (DBI) is a process in which teachers use progress data to make ongoing instructional decisions for students with learning disabilities. Curriculum-based measurement (CBM) is a common form of progress monitoring, and CBM data are placed on a graph to guide decision-making. Despite the central role that graph interpretation plays in the successful implementation of DBI, relatively little attention has been devoted to investigating this skill among special education teachers. In the present study, we examined the data decisions of 32 U.S. pre-service special education teachers (29 females and 3 males). Participants viewed data presented sequentially on CBM progress graphs and used a think-aloud procedure to explain their reasoning each time they indicated they would make instructional changes. We also asked participants to make the same type of decisions in response to static CBM progress graphs depicting 10 weeks of data. Overall, there was inconsistency in pre-service teachers' responses related to when or why they would make an instructional change. Decisions were often influenced by graph-related features, such as variability in the data. Furthermore, responses suggested misunderstandings that led to premature instructional change decisions and reliance on individual data points.</p> <p>Keywords: curriculum-based measurement; graph interpretation; progress monitoring; data-based decision-making; reading</p> <p>Students with or at risk for learning disabilities (LD) often require intervention supports that are more intensive and individualized than their peers without disabilities. Data-based instruction (DBI) is an approach in which teachers collect and use student progress data to evaluate the effects of instruction and guide decisions about when to adjust instruction ([<reflink idref="bib7" id="ref1">7</reflink>]; [<reflink idref="bib28" id="ref2">28</reflink>]). Also referred to as data-based individualization ([<reflink idref="bib28" id="ref3">28</reflink>]) or data-based program modification ([<reflink idref="bib7" id="ref4">7</reflink>]), research has demonstrated that DBI results in significant improvements in the academic performance of students with LD ([<reflink idref="bib14" id="ref5">14</reflink>]; [<reflink idref="bib26" id="ref6">26</reflink>]) and even larger effects associated with greater use of data ([<reflink idref="bib19" id="ref7">19</reflink>]).</p> <p>Concerningly, investigations of teachers' data use have suggested that they struggle with the essential element of DBI—making instructional decisions based on data. In particular, teachers often have difficulty interpreting graphs that display student progress data ([<reflink idref="bib12" id="ref8">12</reflink>]; [<reflink idref="bib38" id="ref9">38</reflink>]; [<reflink idref="bib40" id="ref10">40</reflink>]; [<reflink idref="bib41" id="ref11">41</reflink>]). Despite the central role that graph interpretation plays in the successful implementation of DBI ([<reflink idref="bib28" id="ref12">28</reflink>]), relatively little attention has been devoted to investigating special education teachers' graph interpretation and associated decision-making. In the present study, we sought to explore the data decisions of pre-service special education teachers in response to simulated progress graphs.</p> <hd id="AN0181621033-2">Student Progress Data</hd> <p>The most common form of assessment data used within DBI is curriculum-based measurement (CBM; [<reflink idref="bib7" id="ref13">7</reflink>]). CBM is an ongoing progress monitoring framework used to evaluate the effectiveness of instruction for students with LD or those receiving intensive forms of support ([<reflink idref="bib7" id="ref14">7</reflink>]; [<reflink idref="bib8" id="ref15">8</reflink>]). Extensive research on CBM has indicated that when teachers regularly collect CBM data <emph>and</emph> use a structured set of decision rules to interpret the data, students demonstrate stronger achievement compared with students of teachers do not use such a process ([<reflink idref="bib34" id="ref16">34</reflink>]). Additionally, teachers who used CBM data are more aware of students' progress and demonstrate greater structure in their teaching, write more specific instructional plans, and tend to set more ambitious goals for their students ([<reflink idref="bib18" id="ref17">18</reflink>]; [<reflink idref="bib34" id="ref18">34</reflink>]).</p> <p>To implement CBM, teachers measure student progress on a frequent (e.g., weekly) basis and place scores on a graph to depict progress. The CBM graph guides teachers' data-based decision-making (see procedures described in [<reflink idref="bib13" id="ref19">13</reflink>]; [<reflink idref="bib35" id="ref20">35</reflink>]). To use a graph to make instructional decisions, the teacher first implements an instructional program and then begins collecting data. The teacher regularly inspects the graph to compare the student's actual rate of growth to their expected rate of growth. A student's trend line that is consistent with the goal line suggests the intervention is having its intended effect and should continue. On the contrary, if the students' rate of growth is lower than expected, it signals a need for an instructional change. The teacher then adjusts the intervention and continues to collect data to evaluate the effects. Other types of decisions might include continuing to collect data because not enough data points have been collected or data are too variable to confidently make a decision; adjusting a goal either because it was too ambitious or not ambitious enough; or reducing the intensity of an intervention because a student has met their goal. By using CBM data to continuously evaluate and adjust instruction, teachers can ensure that students are receiving appropriately aligned and intensified intervention support.</p> <p>Two types of decision frameworks have been traditionally recommended for making instructional decisions with CBM data: <emph>point rules</emph> and <emph>slope rules</emph> ([<reflink idref="bib2" id="ref21">2</reflink>]; [<reflink idref="bib28" id="ref22">28</reflink>]). When using a point rule approach, the student's most recent three or four consecutive data points are compared with the goal line. All of these consecutive data points being below the goal line suggests the need for an instructional change. The slope rule approach involves comparing the steepness of the student's trend line (i.e., slope) to the goal line. A trend line that is less steep than the goal line suggests an instructional change is needed because the student's rate of growth is such that they will fall short of their goal. On the contrary, when the trend line is as steep or steeper than the goal line, it is an indication the current intervention is adequately supporting the student's growth.</p> <p>In short, the use of CBM data to adjust instruction to meet students' needs is an essential part of DBI. There are two key decision points in DBI: (a) deciding <emph>whether</emph> to adjust instruction, and (b) deciding <emph>how</emph> to adjust instruction. To determine <emph>whether to adjust instruction</emph>, teachers must accurately evaluate CBM progress graphs. Then, to determine <emph>how to adjust instruction</emph>, teachers must identify appropriate adjustments by analyzing the student's instructional program and learning characteristics. However, before this can happen, teachers must be able to accurately identify whether an instructional change is necessary—this requires proficiency in using data to inform decision-making. In other words, they must accurately read and interpret CBM progress graphs.</p> <hd id="AN0181621033-3">Graph Interpretation for Instructional Decision-Making</hd> <p>On the face of it, CBM progress graphs are simple; however, research on graph comprehension in general reveals that <emph>even simple graphs</emph> can be challenging for adults to read and interpret ([<reflink idref="bib16" id="ref23">16</reflink>]). Previous research has indicated that teachers often are unable to produce complete and coherent descriptions of CBM graphs, do not inspect CBM graphs in a sequential manner, and often fail to attend to relevant features of the graph ([<reflink idref="bib12" id="ref24">12</reflink>]; [<reflink idref="bib38" id="ref25">38</reflink>]; [<reflink idref="bib40" id="ref26">40</reflink>]; [<reflink idref="bib41" id="ref27">41</reflink>]).</p> <p>[<reflink idref="bib37" id="ref28">37</reflink>] conducted a systematic review of studies focused on individuals' interpretation of graphs that display individual student data collected from academic program monitoring measures. More than 60% of the participants across the 21 included studies were teachers. In studies wherein participants were asked to examine a graph and determine whether a student was making adequate progress, graphs that were more difficult to interpret were those that included fewer data points, more variability in the data, extreme values, shifts in data, and small differences in slope values ([<reflink idref="bib10" id="ref29">10</reflink>]; [<reflink idref="bib27" id="ref30">27</reflink>]; [<reflink idref="bib32" id="ref31">32</reflink>]; [<reflink idref="bib39" id="ref32">39</reflink>]). Therefore, the common characteristics of students with LD and their responsiveness to intervention, including slow or inconsistent progress ([<reflink idref="bib4" id="ref33">4</reflink>]; [<reflink idref="bib9" id="ref34">9</reflink>]; [<reflink idref="bib30" id="ref35">30</reflink>]), and variability in performance over time ([<reflink idref="bib2" id="ref36">2</reflink>]), are factors that make graphs more difficult for teachers to interpret correctly.</p> <p>In previous research, graph interpretation skills have been typically investigated by asking participants to evaluate and make decisions based on a complete, static CBM progress graph (i.e., a graph containing at least 8 data points, reflecting approximately 8 weeks of instruction). Indeed, [<reflink idref="bib37" id="ref37">37</reflink>] found that all but one of the 21 studies included in their review displayed static graphs as stimuli for participants, with graphs displaying anywhere from 4 to 60 data points. One study manipulated the display condition so that participants were shown either a static graph or a graph wherein the data appeared sequentially with multiple data points collected each week ([<reflink idref="bib21" id="ref38">21</reflink>]). The use of static graphs potentially limits our understanding of how individuals make data decisions; it does not reflect how progress data are used in real practice, wherein teachers collect, graph, and interpret data on an ongoing basis. Thus, our understanding of special education teachers' decision-making skills is limited by a lack of studies that have simulated the conditions under which CBM data are actually used.</p> <hd id="AN0181621033-4">Purpose of the Present Study</hd> <p>This study investigated special education pre-service teachers' interpretations of CBM reading progress graphs. Across previous studies of graph interpretation, less than 2% of the total participants were special education teachers ([<reflink idref="bib37" id="ref39">37</reflink>])—although this is the group most commonly responsible for the delivery of intensive interventions for students with disabilities. Although CBM data may serve various purposes, we focus on decision-making within DBI wherein teachers engage in an ongoing process of using CBM progress data to inform instruction.</p> <p>Thus, participants were asked to make data-based decisions in response to sequential progress data and displayed one data point at a time, similar to how they would collect and view data in real life. We focused on the decision of whether to continue or change instruction as each data point was added to the graph. When a participant indicated that they would make an instructional change, we asked them to use a think-aloud procedure similar to the method used by [<reflink idref="bib38" id="ref40">38</reflink>] to explain the reasoning behind their decision. Finally, we asked participants to make the same type of decisions in response to static CBM progress graphs depicting ten weeks of complete data. In sum, we sought to address the following three research questions:</p> <p></p> <ulist> <item> <bold> Research Question 1: </bold> What instructional decisions do pre-service special education teachers make in response to sequentially presented CBM progress graphs and are there differences in their decision-making related to various CBM graph-related features?</item> <p></p> <item> <bold> Research Question 2: </bold> Based on pre-service special education teachers' think-aloud responses, how does their interpretation of the CBM progress graph inform their instructional decision-making?</item> <p></p> <item> <bold> Research Question 3: </bold> What instructional decisions do pre-service special education teachers make in response to complete, static CBM progress graphs as compared to the sequentially presented graphs?</item> </ulist> <hd id="AN0181621033-5">Method</hd> <p></p> <hd id="AN0181621033-6">Participants</hd> <p>Data were collected from 32 pre-service teachers recruited from across the United States. All participants were enrolled in university-based special education teacher preparation programs, with the majority in undergraduate programs (<emph>n</emph> = 30). Participants reported their current year in their training program: 12 juniors (third year of undergraduate program), 9 seniors (fourth year), 9 sophomores (second year), and 2 graduate teacher preparation program. The majority of participants identified as female (<emph>n</emph> = 29; 90.6%). Participants identified as White (<emph>n</emph> = 13; 40.6%), Hispanic/Latinx (<emph>n</emph> = 11; 34.4%), Black or African American (<emph>n</emph> = 6; 18.8%), and one person identified each as Asian and multiracial (<emph>n</emph> = 2; 6.2%). Although participants were recruited from across the United States, the majority resided in Texas (<emph>n</emph> = 29) distributed between two institutions (22 from one and 7 from the other). The remaining three participants resided in Oregon, Pennsylvania, and Virginia.</p> <p>With regard to prior training, participants were asked to report whether they had completed coursework that included a focus on (a) how to use student assessment data to make instructional decisions or (b) CBM, specifically. Most participants reported having taken at least one course on using data to inform instructional decisions (87.5%; <emph>M</emph> = 1.77 courses, <emph>SD</emph> = 2.07) and at least one course that explicitly covered CBM (90.1%; <emph>M</emph> = 1.41 courses, <emph>SD</emph> = 1.01).</p> <hd id="AN0181621033-7">Procedures</hd> <p>Participants were recruited through special education listservs, social media, and professional networks (e.g., teacher preparation program coordinators). Respondents' information was screened by the primary author to ensure that they were pre-service teachers enrolled in university-based programs in the United States. Each participant was sent an electronic version of the consent letter and a link to schedule their individual study session.</p> <p>Due to the onset of the COVID-19 pandemic, the majority of sessions were conducted via videoconference (<emph>n</emph> = 26; 81.3%), although six sessions with local participants had already been conducted in person in a quiet meeting room on campus. All sessions were audio-recorded for the purpose of transcription and coding reliability. Each study session began with a verbal explanation of the study procedures and obtaining informed consent, followed by a simulation activity wherein participants were asked to view and interpret student progress graphs.</p> <p>The simulation activity is further described in the next section. Finally, participants were provided with a link to a Qualtrics survey wherein they provided demographic information. Total session times ranged from 14:50 to 33:06 min, with an average length of 20:42 min across participants.</p> <hd id="AN0181621033-8">Graph Interpretation Simulation Activity</hd> <p></p> <hd id="AN0181621033-9">Creation of Materials</hd> <p>We created four datasets for hypothetical student cases. The graphs displayed oral reading fluency (ORF) data (i.e., words read correct per minute [WCPM]). We held the initial score, target rate of growth, and year-end goal constant; all cases began intervention with a baseline score of 40 WCPM, and all had an expected rate of growth of 2 WCPM each week, resulting in a target end-of-year goal of 112 WCPM across 35 weeks of intervention. From this dataset, we generated CBM progress graphs for the four different student cases.</p> <p>Data points for the four student cases were randomly generated based on a pre-defined rate of growth (i.e., on track or not on track to meet goal) and degree of variability (i.e., low or more typical variability). We modeled "typical" variability for this study as ±12 points around a linear slope. We based this decision on previous research that observed standard errors generally ranging from 10 to 15 points per occasion on commercial CBM ORF passage sets with students in middle to late elementary grades ([<reflink idref="bib1" id="ref41">1</reflink>]; [<reflink idref="bib3" id="ref42">3</reflink>]), and differences in average scores between probes in a grade-level set (i.e., passage with highest mean WCPM minus passage with lowest WCPM) ranging up to 27 WCPM ([<reflink idref="bib6" id="ref43">6</reflink>]). In contrast to typical variability, we modeled "low" variability as ±6 points around a linear slope. This low level of variability is not common in practice but is frequent in examples used in CBM and progress monitoring training materials (e.g., [<reflink idref="bib24" id="ref44">24</reflink>]; [<reflink idref="bib29" id="ref45">29</reflink>]).</p> <p>Case 1 depicted a student who was on track to meet their end-of-year goal and with low variability in the data. Data were generated to represent an average of 2 WCPM gain per week with ±6 points around a linear slope. This case also included one outlying extreme low data point. Case 2 represented a student who was not on track to meet their end-of-year goal and data reflected a typical degree of variability. In this case, the student had a rate of growth that averaged 0.5 WCPM gain per week with ±12 points around a linear slope. Case 3 depicted a student who was on track to meet their goal, and their data showed a typical range of variability. This student had an average rate of growth of 2 WCPM gain per week and ±12 points around a linear slope. Finally, Case 4 represented a student who was not on track to meet their goal, and variability in the data was low; this student had an average rate of growth of 0.5 WCPM of gain per week and variability of ±6 points around linear slope.</p> <hd id="AN0181621033-10">Tutorial</hd> <p>Participants were informed that they were going to look at four student cases, and all students were third grade boys identified with a reading disability who had similar academic profiles and were receiving supplemental reading intervention (e.g., Tier 2) at school. They were told that the progress of each student was being monitored once per week with CBM ORF, and each case would represent a total of 10 weeks of student progress data.</p> <p>Next, participants were provided with a brief tutorial on the elements of a CBM progress graph to ensure that they had access to consistent terminology when describing the graphs and explaining the rationale for their decisions. The tutorial began by displaying a sample graph with a full year of progress data and participants were told "you will be asked to look at student progress data on a graph like this one." They were told that each data point represented a student's score, measured as words read correct per minute (WCPM), on a CBM ORF. The researcher then displayed a series of animated slides to identify and label the various components of the graph: baseline score (e.g., data collected to measure performance prior to the start of the intervention); data points (e.g., weekly ORF assessment scored as WCPM); the student's goal (e.g., calculated end-of-year target); goal line (e.g., expected rate of growth for student will reach goal); and the student's trend line (e.g., observed or actual rate of growth). It was then explained that participants would see a series of slides in which data points will appear as they are being collected—week by week.</p> <hd id="AN0181621033-11">Graph Interpretation</hd> <p>First, participants viewed graphs for the four student cases with data presented sequentially; cases were always presented in the same order (i.e., Case 1 to Case 4) to hold constant any potential influence of previous cases on participants' responses. Participants were shown the graph with one data point, followed by two data points on the next slide, and so forth. After each new data point, we asked participants how they might interpret the data. They were given three response options: (a) continue with the intervention; (b) make a change to the intervention; or (c) I don't know, which they were asked to select only if they were not sure how to interpret the graph to inform their decision. Participants were also told that, for each new data point, they should consider the new data point together with the previous data collected—that is, ignoring any previous decisions, consider their response based on the currently displayed data points. If the participants responded that they would make a change, they were asked to explain what led them to make this decision.</p> <p>Finally, participants were shown four static graphs with 10 weeks of data (see Figure 1). These graphs included the same generated data for Cases 1 through 4 described earlier; however, participants were not informed that these complete graphs were the same as those that they had been viewing sequentially. The researcher explained that each graph included individual student data that a teacher had collected weekly, but only viewed after 10 weeks. Based on the displayed graph, participants were asked whether they would have made an instructional change for this student—and if so, to indicate the date when that instructional change should have happened.</p> <p>Graph: Figure 1. Curriculum-Based Measurement Progress Graphs Generated for Four Hypothetical Cases (10 Weeks)</p> <hd id="AN0181621033-12">Data Sources</hd> <p>We collected three sources of data based on participants' completion of the simulation activity. First, we examined participant responses for each data point during the sequential graph interpretation. This included 40 responses per participant (i.e., 10 data points for each of the four cases). Second, we coded all think-aloud responses provided during sequential graph interpretation. Participants provided a think-aloud response only when they indicated that they would make a change in response to one of the 40 data points (4 cases × 10 weeks) in the sequential graph interpretation activity. For example, responses may have included rationale such as "Now it's dropped way further down under the orange line." Finally, we examined participant graph interpretation responses when shown the four complete, static graphs.</p> <hd id="AN0181621033-13">Coding Procedures</hd> <p>Think-aloud responses were transcribed verbatim from audio recordings. The transcribed text was then coded by three members of the author team, informed by coding procedures used in previous graph interpretation work (i.e., [<reflink idref="bib12" id="ref46">12</reflink>]; [<reflink idref="bib38" id="ref47">38</reflink>]). Led by the primary author, the initial codebook was developed collaboratively while coding two participant responses. We established reliability through a two-step process with the same three researchers. First, we independently coded two participant responses and then came together to compare coding decisions. We divided the number of agreements by the number of total possible decisions, resulting in 94% agreement across all codes. The codebook was further refined at this point, which included merging or adding codes, expanding variable descriptions, and documenting examples for each code. Next, we independently coded two additional participant responses and obtained 96.7% agreement; we met to reach a consensus on any discrepancies (e.g., codes that did not have agreement across all three researchers). Finally, each of the remaining 28 participant think-aloud responses were independently coded by two researchers and any discrepancies were discussed to reach consensus.</p> <p>The final codebook included 10 variables related to participants' interpretations of student progress graphs and data-based decision-making. Each individual response was coded as <emph>present</emph> (<reflink idref="bib1" id="ref48">1</reflink>) or <emph>not present</emph> (0) for each of the 10 variables and could be given multiple codes. Table 1 includes a summary of the codebook variables with descriptions and examples.</p> <p>Table 1. Think-Aloud Codebook.</p> <p>Graph</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th align="center">Variable</th><th align="center">Description</th><th align="center">Example(s)</th></tr></thead><tbody><tr><td>RATE<italic>Trend-to-goal comparison</italic></td><td>Commenting on the difference or gap between the current rate (trend line) and the expected rate of growth (goal line)</td><td>Trend line is still below the goal line; his actual performance is lower than his expected performance</td></tr><tr><td>POINT<italic>Data-to-goal comparison</italic></td><td>Commenting on individual data point (or small set of data points) compared with goal line</td><td>Three data points are all below the goal line; he dropped below both lines</td></tr><tr><td>DATA<italic>Point-to-point comparison</italic></td><td>Commenting on data point in isolation and/or in relation to previous data points; no comparison to trend or goal lineDo not code DATA as "1" if same item is coded "1" for RATE, POINT, or PROG</td><td>He dropped this week; it went down a few points</td></tr><tr><td>PROGRESS</td><td>Reference to progress (or lack thereof) without any specific or systematic comparison between trend/goal/points; ambiguousDo not code PROG as "1" is same item is coded "1" for RATE, POINT, or DATA</td><td>There hasn't been much growth; not seeing any improvement; something is not working; nothing's happening; things are staying the same</td></tr><tr><td>VARIABILITY</td><td>Commenting on variability of data points (or lack of variability/stability)</td><td>Ups and downs; waiting after drop to see if it's a fluke; spikes; go up very high and then just drop; fluctuation</td></tr><tr><td>OUTLIER</td><td>Commenting on extreme change for an individual datapoint (e.g., decrease or increase)</td><td>Dropping; really fell; he dropped way down; dramatic drop; dropped quickly</td></tr><tr><td>STUDENT<italic>Student-related factors</italic></td><td>Commenting on factors internal to the student and their academic, cognitive, social-emotional, or behavioral skills</td><td>Confidence; misunderstanding; slow in coming to understand; having a bad day; he doesn't know how to speak out and ask for help</td></tr><tr><td>FIDELITY</td><td>Commenting on factors related to implementation, such as intervention or assessment fidelity, as explanatory for student performance; procedures are being implemented incorrectly</td><td>Not delivery intervention consistently; changing days or times; see if something is "wrong"</td></tr><tr><td>ALIGNMENT</td><td>Commenting on "fit" of intervention for student; the need to reevaluate service delivery level (e.g., Tier 3, specialist) to meet the student's needs; intensifying the intervention; intervention is not aligned or appropriate for student needs</td><td>Move from Tier 2 to 3; needing a different program; small group or individual</td></tr><tr><td>GOAL<italic>Adjust student's goal</italic></td><td>Commenting on the need to change the student's long-range goal because they are not making adequate progress (or they are surpassing goal their goal)</td><td>Maybe their goal should be altered; maybe the goal is too high for him</td></tr></tbody></table> </ephtml> </p> <hd id="AN0181621033-14">Results</hd> <p></p> <hd id="AN0181621033-15">Interpretation of Sequentially Presented Graph</hd> <p>To examine RQ1, we were interested in the decisions pre-service special education teachers made in response to sequentially presented CBM progress graphs and how these decisions may be related to different CBM data patterns. We calculated the total number of change decisions for each data point across the four student cases. We use the term "change decision" to refer to an instance in which a participant indicated that they would make a change to the intervention. Table 2 summarizes the total number of change decisions made across each case and for each data point within the cases.</p> <p>Table 2. Number of Change Decisions at Each Data Point Across Participants (n = 32).</p> <p>Graph</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th /><th align="center" colspan="11">Data point ("Week")</th></tr><tr><th align="center">Student</th><th align="center">1</th><th align="center">2</th><th align="center">3</th><th align="center">4</th><th align="center">5</th><th align="center">6</th><th align="center">7</th><th align="center">8</th><th align="center">9</th><th align="center">10</th><th align="center">Total</th></tr></thead><tbody><tr><td>Case 1</td><td>3</td><td>2</td><td>1</td><td>16</td><td>2</td><td>5</td><td>21</td><td>3</td><td>17</td><td>2</td><td><bold>72</bold></td></tr><tr><td>Case 2</td><td>0</td><td>13</td><td>8</td><td>2</td><td>21</td><td>24</td><td>4</td><td>22</td><td>21</td><td>11</td><td><bold>126</bold></td></tr><tr><td>Case 3</td><td>9</td><td>0</td><td>1</td><td>15</td><td>0</td><td>0</td><td>11</td><td>2</td><td>21</td><td>3</td><td><bold>62</bold></td></tr><tr><td>Case 4</td><td>2</td><td>7</td><td>19</td><td>5</td><td>18</td><td>8</td><td>27</td><td>10</td><td>21</td><td>11</td><td><bold>128</bold></td></tr></tbody></table> </ephtml> </p> <p>1 <emph>Note.</emph> Baseline data points are not included here. Data point 1 represents the first week of intervention.</p> <p>Participants suggested the greatest number of changes for the cases that represented students who were not on track to meet their end-of-year goals. Specifically, there were 126 change decisions across participants for Case 2 (not on track, data typically variable) and 128 change decisions for Case 4 (not on track, data less variable), compared with 72 and 62 for Case 1 (on track, data less variable) and Case 3 (on track, data typically variable), respectively.</p> <p>Across all four cases, there was an average of 12.78 change decisions (<emph>SD</emph> = 7.04), ranging from 4 to 31 changes across these 40 data points. Within participants, change decisions ranged from 0 to 7 for Case 1 (<emph>M</emph> = 2.41, <emph>SD</emph> = 1.86), 1 to 10 for Case 2 (<emph>M</emph> = 4.22, <emph>SD</emph> = 2.45), 0 to 7 for Case 3 (<emph>M</emph> = 1.94, <emph>SD</emph> = 1.70), and 1 to 10 for Case 4 (<emph>M</emph> = 4.22, <emph>SD</emph> = 2.35). This was similar to the pattern of responses across participants—a greater number of change decisions for the cases representing students not on track to meet their goals.</p> <p>The majority of participants (<emph>n</emph> = 21; 65.6%) indicated that they would make an instructional change in response to the outlier or extreme data point in Case 1 (Week 7). The tendency to respond to variability between one, single data point to next was a common pattern. For instance, there was a surprising number of participants who indicated that they would make an instructional change within the first 3 weeks of data collection (see Table 2), which represented only 3 weeks of intervention in the cases. Nine (28.1%) participants responded that they would change instruction after viewing the first data point after baseline (Week 1) for Case 3. Thirteen (40.6%) participants responded with a change decision after viewing Week 2 data for Case 2 as there was a noticeable decrease in the student's WCPM score from Week 1 to 2. Notably, half of the participants (<emph>n</emph> = 19; 59.4%) made a change decision at Week 3 for Case 4 although the decrease in WCPM from the previous week was minimal. Overall, across the four cases, there were 65 change decisions made in response to the first three data points.</p> <hd id="AN0181621033-16">Decision-Making Think-Alouds</hd> <p>Next, to address RQ2, we coded participants' think-aloud responses when asked to explain their reasons for making a change in response to the graphed data. These responses allowed us to better understand the ways in which graphs were being interpreted to guide instructional decision-making. As previously described, we coded for ten reasons that could potentially be present in participants' decision-making (see Table 1). The percentage of participant responses that referenced each of the reasons for making an instructional change, within and across cases, are reported in Table 3.</p> <p>Table 3. Reasons for Making Instructional Change Based on Coding of Think-Aloud Responses.</p> <p>Graph</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th /><th align="center" colspan="10">Reasons for making a change</th></tr><tr><th align="center">Student</th><th align="center">Rate (%)</th><th align="center">Point (%)</th><th align="center">Data (%)</th><th align="center">Prog (%)</th><th align="center">Var (%)</th><th align="center">Out (%)</th><th align="center">Student (%)</th><th align="center">Fidelity (%)</th><th align="center">Alignment (%)</th><th align="center">Goal (%)</th></tr></thead><tbody><tr><td>Case 1</td><td>11.11</td><td>51.39</td><td>33.33</td><td>5.56</td><td>9.72</td><td>26.39</td><td>12.50</td><td>1.39</td><td>1.39</td><td>0</td></tr><tr><td>Case 2</td><td>14.29</td><td>42.06</td><td>34.92</td><td>10.32</td><td>6.35</td><td>7.94</td><td>4.76</td><td>0</td><td>15.08</td><td>1.59</td></tr><tr><td>Case 3</td><td>17.74</td><td>50.00</td><td>31.65</td><td>6.45</td><td>8.06</td><td>4.84</td><td>3.23</td><td>0</td><td>9.68</td><td>0</td></tr><tr><td>Case 4</td><td>21.09</td><td>42.97</td><td>32.03</td><td>8.59</td><td>8.59</td><td>0</td><td>3.91</td><td>0</td><td>12.50</td><td>0.78</td></tr><tr><td>Across Cases</td><td>16.49</td><td>45.36</td><td>32.99</td><td>8.25</td><td>7.99</td><td>8.25</td><td>5.67</td><td>2.58</td><td>1.08</td><td>0.77</td></tr></tbody></table> </ephtml> </p> <p>2 <emph>Note.</emph> Because participants were able to select multiple reasons per decision, these percentages may total to greater than 100% across a given case. Prog = Progress; Var = Variability; Out = Outlier.</p> <p>Participants' reasons for making an instructional change were most commonly based on comparing student data to their goal line. Across cases, 45.36% of participants' think-aloud responses referenced an individual data point, or a small set of data points, in relation to the goal line (i.e., data-to-goal comparison). Responses sometimes included reasons such as "That is now three points [below the goal line] that we've gotten, we have a lot of data and it's not getting better," but they were more likely to consider points below the goal line without a specific decision rule in place (e.g., "The data is still dropping below").</p> <p>The second most common reason for making a change, referenced in 32.99% of responses, relied on analysis of individual data points in isolation or in relation to previous data points—without any type of comparison to the trend or goal line (i.e., point-to-point comparison). For example, when participants indicated they would make an instructional change after viewing Week 2 data for Case 2, they made comments such as "They started off doing good and now they declined," "I guess he dropped about 16 words," and "It dropped really quickly. Really, really suddenly." Trend-to-goal comparisons were referenced in only 16.49% of responses across cases, ranging from 11.11% of responses in Case 1% to 21.09% of responses in Case 4. Participants made comments here such as: "The trend line is really low and it doesn't... it's nowhere near the goal. Like, it's really a huge gap." The greatest number of change decisions were made in response to Week 7 data for Case 4 (<emph>n</emph> = 27), and 12 participants referenced data-to-goal comparisons and 10 referenced point-to-point comparisons.</p> <p>Across cases, 5.67% of responses referenced factors internal to the student and their academic, cognitive, social-emotional, or behavioral skills—despite there being no student information provided with the case. For example, "He has to be like scared to ask for help and just doesn't wanna probably, some students feel like they don't know how to speak out and ask if they need some help" or "Maybe pick up his confidence to be able to get above the goal line."</p> <p>Compared with the other cases, Case 1 had the greatest percentage of responses (26.39%) that referred to an outlier or extreme data point. Participants also commented on the variability of the data, ranging from 6.35% in Case 2% to 9.72% in Case 1. Although variability was indirectly referenced in responses that we coded as point-to-point comparisons, these were instances when participants explicitly remarked on the variability—or lack of stability—in the data and identified this as the reason to change instruction. For example, "He's not really increasing. He'll increase for one session, but the next he's not any better."</p> <hd id="AN0181621033-17">Comparison to Interpretation of Static Progress Graph</hd> <p>Finally, to address RQ3, we compared the decisions made while viewing a graph with data presented week-by-week for 10 weeks (i.e., sequentially presented graphs) to decisions made while viewing a graph with 10 weeks of complete data (i.e., static CBM progress graph). The same four cases were used. When viewing the complete graphs, participants were asked whether they would have made an instructional change and, if so, what week they would have implemented the change. Table 4 presents a summary of change decisions for the four cases.</p> <p>Table 4. Participants' Change Decisions Based on Interpretation of Static Graphs.</p> <p>Graph</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th /><th align="center" rowspan="2">No change</th><th align="center" colspan="10">Numbers of changes at each point (%)</th></tr><tr><th align="center">Student</th><th align="center">1</th><th align="center">2</th><th align="center">3</th><th align="center">4</th><th align="center">5</th><th align="center">6</th><th align="center">7</th><th align="center">8</th><th align="center">9</th><th align="center">10</th></tr></thead><tbody><tr><td>Case 1</td><td>10 (31.3%)</td><td>1 (3.1%)</td><td>1 (3.1%)</td><td>1 (3.1%)</td><td>1 (3.1%)</td><td align="center">—</td><td>1 (3.1%)</td><td>11 (34.4%)</td><td>3 (9.4%)</td><td>3 (9.4%)</td><td align="center">—</td></tr><tr><td>Case 2</td><td align="center">—</td><td>1 (3.1%)</td><td>7 (21.9%)</td><td>3 (9.4%)</td><td>3 (9.4%)</td><td>10 (31.3%)</td><td>6 (18.8%)</td><td>1 (3.1%)</td><td align="center">—</td><td>1 (3.1%)</td><td align="center">—</td></tr><tr><td>Case 3</td><td>16 (50.0%)</td><td>2 (6.3%)</td><td align="center">—</td><td>1 (3.1%)</td><td>4 (12.5%)</td><td align="center">—</td><td align="center">—</td><td>4 (12.5%)</td><td align="center">—</td><td>5 (15.6%)</td><td align="center">—</td></tr><tr><td>Case 4</td><td align="center">—</td><td>1 (3.1%)</td><td>3 (9.4%)</td><td>13 (40.6%)</td><td>6 (18.8%)</td><td>7 (21.9%)</td><td>1 (3.1%)</td><td>1 (3.1%)</td><td align="center">—</td><td align="center">—</td><td align="center">—</td></tr></tbody></table> </ephtml> </p> <p>For the two cases that represented students who were on track to meet their end-of-year goal (i.e., Cases 1 and 3), many participants indicated that they would not have made an instructional change. Specifically, almost one-third of respondents (<emph>n</emph> = 10; 31.3%) for Case 1 and half of respondents (<emph>n</emph> = 16; 50%) for Case 3 indicated that they would not make an instructional change at any point. This contrasted responses when participants viewed the sequentially presented graphs wherein the number of participants that indicated that they would not have made an instructional change was only three participants (9.3%) for Case 1 and seven participants for Case 3 (21.9%).</p> <p>For Case 1, with low variability, those who made a change decision most commonly indicated that they would have made a change at Week 7 (<emph>n</emph> = 11; 34.4%), and the remaining eleven responses (34.4%) were across every data point except for Week 3 and 5, both of which showed a slight increase in the student's WCPM score from the previous week. Only half of the participants responded with a change decision for Case 3, the case with typical variability in the data, and there did not appear to be any consistency in their reports of when they would have made this instructional change.</p> <p>For the two cases where the students were not on track to meet their goal (i.e., Cases 2 and 4), every participant indicated that they would have made an instructional change at some point. This was true for both the sequential and static presentation of the graphed data for these cases. For Case 2, the student with typical variability in their data, all participants indicated that they would have made an instructional change. Most commonly, these changes were made at Week 2 (<emph>n</emph> = 7; 21.9%), Week 5 (<emph>n</emph> = 10; 31.3%), and Week 6 (<emph>n</emph> = 6; 18.8%), with the remaining responses scattered across weeks. Similarly, all participants responded with a change decision for Case 4 (low variability). Forty percent (<emph>n</emph> = 13) indicated that they would have made this change at Week 3, 18.8% (<emph>n</emph> = 6) at Week 4, and 21.9% (<emph>n</emph> = 7) at Week 5. There were no changes indicated after Week 7.</p> <hd id="AN0181621033-18">Discussion</hd> <p>The purpose of this study was to contribute to our understanding of the ways in which teachers evaluate CBM progress graphs and the factors that influence their decision-making. Among a group of pre-service special education teachers, over 90% of which reported taking coursework that included CBM, we observed little consistency in decisions about when to adjust instruction. Think-aloud responses reflected erroneous information about instructional decision-making and typical student performance on CBM reading assessments. Consistent with other studies that observed problems in pre- and in-service teachers' ability to interpret graphed CBM data (e.g., [<reflink idref="bib10" id="ref49">10</reflink>]; [<reflink idref="bib33" id="ref50">33</reflink>][<reflink idref="bib38" id="ref51">38</reflink>]; [<reflink idref="bib40" id="ref52">40</reflink>]) change decisions appeared to be influenced by graph-related features, including the specific pattern of student progress (i.e., on track or not on track to meet goal) and variability in the data (i.e., low or more typical variability). Furthermore, responses indicated misunderstandings of progress graphs and data-based decision-making, which led to premature instructional change decisions and reliance on individual data points. We expand on each of these findings in the sections below.</p> <hd id="AN0181621033-19">Graph-Related Factors That Influence Interpretation</hd> <p></p> <hd id="AN0181621033-20">Patterns of Student Progress</hd> <p>Of the four hypothetical student cases, two cases presented data for students who were on track to meet their end-of-year goal and two cases presented data for students who were not on track; but within each set, one case had very low variability in the data and one had typical variability across data points. We found that participants appeared to have an easier time interpreting graphs wherein the data clearly indicated the student was not making progress. This was true for both sequentially presented graphs and static progress graphs. Past research has indicated that the magnitude of the slope, in either positive or negative directions, tends to lead to the highest accuracy in graph reading ([<reflink idref="bib10" id="ref53">10</reflink>]).</p> <p>That said, many participants still said they would make changes when viewing a static graph that showed expected growth—two-thirds for Case 1, and one-half for Case 3. The static graphs for these cases depicted trend lines that closely approximated the goal line. This offers some evidence that participants were influenced by individual data points and not accustomed to basing their decisions on the data in aggregate or the students' trend lines. It is also possible that some participants felt that they were expected to respond with an instructional change, even though our directions did not communicate such an expectation.</p> <hd id="AN0181621033-21">Variability in the Data</hd> <p>We purposefully developed our four student cases to reflect two levels of variability in the data based on prior research with CBM ORF passage sets ([<reflink idref="bib1" id="ref54">1</reflink>]; [<reflink idref="bib5" id="ref55">5</reflink>]; [<reflink idref="bib3" id="ref56">3</reflink>]; [<reflink idref="bib6" id="ref57">6</reflink>]); a very low level of variability (±6 points around the average rate of growth) that is often depicted in training examples (e.g., [<reflink idref="bib24" id="ref58">24</reflink>]; [<reflink idref="bib29" id="ref59">29</reflink>]) but seldom observed in practice, and a level of variability that is more commonly observed with commercial CBM passage sets (±12 points around the average rate of growth). Consistent with prior work (e.g., [<reflink idref="bib33" id="ref60">33</reflink>]), when data were more variable, participants were less clear and less consistent on when they would make an instructional change. Many participants noted variability in the data but interpreted this as the intervention being ineffective rather than recognizing the variation that is typically observed in students' scores over time. When responding to cases with typical variability (Cases 2 and 3), participants repeatedly identified a need to change intervention based on a single data point that was lower than a previous one, although the data point was within the typical standard error observed across commercial passage sets. In contrast, participants demonstrated greater consistency in their decisions pertaining to the cases with less variable data (Cases 1 and 4). Again, we note that the data used for these cases were atypically low in variability relative to true CBM ORF data—especially for students who are experiencing struggles with reading (e.g., [<reflink idref="bib9" id="ref61">9</reflink>]).</p> <p>Thus, while participants' think-aloud responses recognized the variability in the data (e.g., "They are going up and they're going down. They're going up and they're going down."), they failed to recognize that this should be expected when collecting progress monitoring data. It is possible that the pre-service teachers had not been exposed to (a) data on the typical level of score variability observed in commercial CBM ORF passage sets; (b) case example graphs that reflected typical variability (and instead depicted scores tightly clustered around an average rate of growth); (c) the multiple factors that can cause ORF score variability; and (d) the importance of considering performance and trend using multiple data points.</p> <hd id="AN0181621033-22">(Mis) Understanding of CBM Progress Graphs for Decision-Making</hd> <p></p> <hd id="AN0181621033-23">Premature Instructional Change Decisions</hd> <p>In this study, we made a purposeful choice not to specify "correct" decisions across all the student progress graphs. The decision-making process is complex; thus, our goal was to capture and describe pre-service teachers' data decisions. That said, there are some decisions that are clearly incorrect and suggest a lack of knowledge from the decision-maker. Most notable here was the alarming number of participants who indicated that they would make an instructional change based on only three or fewer data points—that is, they made a decision to change instruction too soon or "prematurely." Across cases, 10.9% of participants made a change decision in response to the Week 1 data point, 17.2% made a change decision in Week 2, and 22.7% made a change decision in Week 3. During the tutorial, participants were explicitly informed that each new data point was collected during each new week of intervention; thus, these decisions may suggest a misunderstanding of how to interpret CBM progress monitoring.</p> <p>It is possible that these premature decisions were due to misperceptions or a lack of understanding of what the construct of oral reading fluency represents, and the extent and speed to which interventions can affect students' reading fluency. Although CBM ORF scores are relatively simple to collect (i.e., recording the number of WCPM), the actual skill of reading connected text with efficiency represents a complex and sophisticated orchestration of skills in word reading and reading comprehension ([<reflink idref="bib25" id="ref62">25</reflink>]). Reading fluency can be improved through intervention, but improvements are generally not observed as readily as some other reading-related skills, such as letter-sound correspondence, pseudoword decoding, or isolated word reading (e.g., [<reflink idref="bib15" id="ref63">15</reflink>]; [<reflink idref="bib22" id="ref64">22</reflink>]; [<reflink idref="bib36" id="ref65">36</reflink>]). Typical rates of growth for typically achieving students in middle elementary grades generally range from 1 to 2 correct words per minute gained per week, but rates of growth decline as grade levels increase and lower achieving readers can demonstrate growth rates more than 50% lower than the overall average ([<reflink idref="bib23" id="ref66">23</reflink>]; [<reflink idref="bib30" id="ref67">30</reflink>], [<reflink idref="bib28" id="ref68">28</reflink>]). A complex, multifaceted skill like ORF does not improve dramatically within 1 week, nor does it decline as rapidly in the same amount of time. Actual "loss" of reading fluency would require a significant period of time in which reading was not practiced. In short, participants' premature decisions to change instruction within the first three weeks of intervention were likely due to inadequate training, experience, and knowledge of what ORF represents and how quickly it can be expected to change.</p> <hd id="AN0181621033-24">Reliance on Individual Data Points</hd> <p>Related to our previous comments on the expected variability in CBM ORF data, even when holding students' reading skills constant, there should be an expectation of fluctuation in scores. Variability in CBM ORF performance across occasions can be caused by differences in passage difficulty across a passage set, individual differences in student background knowledge that can make the topics of some passages more familiar than others, fluctuations in a student's mood or attention across testing occasions, and variations in the testing environment (i.e., more or less distracting from week to week) or examiner that affect student performance. Variability in scores should be viewed as the norm rather than an exception. As such, reliance on single data points for decision-making rather than overall trend or larger groups of data points in aggregate likely represents a knowledge gap that had not been previously addressed by coursework and other CBM training resources.</p> <p>In the current study, the number of participants who recommended instructional changes based on one single data point was concerning. Among reasons for making an instructional change, data point-to-goal comparison was most referenced (45.36% of all think-aloud responses). These were instances wherein participants commented on an individual or small set of data points compared with the goal line. Some participants' responses indicated they applied the point rule to their decision-making; however, only 13 of 176 data-to-goal comparisons referred to the most recent three or four consecutive data points compared to the goal line. Furthermore, point-to-point comparison was the second most common reason for making an instructional change (32.99%). These were instances when the participant commented on an individual data point in isolation without comparison to the trend or goal line.</p> <hd id="AN0181621033-25">Limitations and Future Directions</hd> <p>We note potential limitations associated with the current study. Each of these offer pathways for future research to expand this work. First, due to the small sample size and restricted geographic representation, it is unclear to what extent these results can be generalized to a broader population of pre-service special education teachers. Furthermore, although we asked participants about their prior coursework and training, we do not have information about the content or quality of these professional learning experiences. In this sample, 87.5% of participants reported completing at least one course on using assessment data to inform instructional decisions and 90.1% reported completing at least one course that covered CBM. Recent reviews of CBM materials developed for practitioner audiences indicate that a woefully low proportion of the content is devoted to the decision-making aspects of CBM. For example, [<reflink idref="bib11" id="ref69">11</reflink>] analyzed CBM professional development materials and found that only 12% of the content in presentations and 14% in manuals/books focused on data-based decision-making. Similarly, [<reflink idref="bib17" id="ref70">17</reflink>] replicated Espin and colleague's analysis with articles published in practitioner journals and found that only 18% of the content focused on decision-making.</p> <p>It is worth noting that the type of decision we focused on is not fully representative of the data-based decision-making process that takes place in schools. Participants were asked to make a decision about <emph>whether</emph> there was a need to continue or adjust instruction based on students' progress data but were not asked to decide <emph>how</emph> instruction would be changed. The former decision relies on graph interpretation, while the latter decision must be informed by context and the student's unique needs. We held all student information constant across the four cases so that we could isolate and independently evaluate participants' decision-making as they interpreted progress graphs. Although this strengthened our design from the standpoint of studying graph interpretation, it highlights a need to investigate the extent to which variables such as student characteristics and instructional history affect teachers' data-based decision-making.</p> <p>We asked teachers to respond to graphs after the addition of each individual data point. Although this is consistent with practice situations in which teachers collect and graph one data point at a time (e.g., once per week), future research might evaluate differences in respondents' decisions when they periodically consider graphs after groups of data points have been entered (e.g., 3 or 4) as compared with one data point at a time.</p> <p>Graph interpretation may also involve decisions about when to raise a goal (e.g., when a student meets their predetermined goal) or when to decide to reduce the intensity of an intervention when a student has met their goal. Subsequent studies might use the sequential methodology employed in this study to investigate the quality of teachers' decisions around goal attainment or goal adjustment. We believe there is potential for think-aloud procedures to be used in future studies that examine teachers' data use to better understand processes related to and potential influences on decision-making.</p> <hd id="AN0181621033-26">Conclusion</hd> <p>Special education teachers must effectively use student progress data to guide and inform instructional decision-making, but this can often be challenging. To date, systematic efforts to improve the quality and effectiveness of teachers' data use have had lackluster results (e.g., [<reflink idref="bib20" id="ref71">20</reflink>]), and other studies have revealed problems in the accuracy with which teachers interpret progress graphs and the quality of the decisions they make based on data. Overall, our findings suggested little consistency in pre-service teachers' responses related to <emph>when</emph> or <emph>why</emph> they would make an instructional change. The results also revealed problematic decision-making trends including decisions based on very little data, reliance on single data points, and a lack of awareness of typical variability in reading CBM data. This was true across participants, as well as within participants from case to case. DBI assumes that teachers can and will use student progress data to guide instructional decision-making; however, findings from the current study indicate that teachers—and particularly pre-service teachers who will be taking on special education roles—may need ongoing support in using data to inform instruction. Teacher training programs should include more hands-on practice with CBM progress graphs to support future special education teachers in understanding natural variability in data, trends in data, and expected growth in students' reading skills over time. Training content should continue to be informed by ongoing scientific inquiry into teachers' data-based decision-making processes.</p> <ref id="AN0181621033-27"> <title> References </title> <blist> <bibl id="bib1" idref="ref41" type="bt">1</bibl> <bibtext> Ardoin S. P., Christ T. J. (2009). Curriculum-based measurement of oral reading: Standard errors associated with progress monitoring outcomes from DIBELS, AIMSweb, and an experimental passage set. School Psychology Review, 38(2), 266–283. https://doi.org/10.1080/02796015.2009.12087837</bibtext> </blist> <blist> <bibl id="bib2" idref="ref21" type="bt">2</bibl> <bibtext> Ardoin S. P., Christ T. J., Morena L. S., Cormier D. C., Klingbeil D. A. (2013). A systematic review and summarization of the recommendations and research surrounding curriculum-based measurement of oral reading fluency (CBM-R) decision rules. Journal of School Psychology, 51(1), 1–18. https://doi.org/10.1016/j.jsp.2012.09.004</bibtext> </blist> <blist> <bibl id="bib3" idref="ref42" type="bt">3</bibl> <bibtext> Christ T. J., Silberglitt B. (2007). Estimates of the standard error of measurement for curriculum-based measures of oral reading fluency. School Psychology Review, 36(1), 130–146. https://doi.org/10.1080/02796015.2007.12087956</bibtext> </blist> <blist> <bibl id="bib4" idref="ref33" type="bt">4</bibl> <bibtext> Christ T. J., Silberglitt B., Yeo S., Cormier D. (2010). Curriculum-based measurement of oral reading: An evaluation of growth rates and seasonal effects among students served in general and special education. School Psychology Review, 39(3), 447–462. https://doi.org/10.1080/02796015.2010.12087765</bibtext> </blist> <blist> <bibl id="bib5" idref="ref55" type="bt">5</bibl> <bibtext> Christ T. J., Zopluoglu C., Monaghen B. D., Van Norman E. R. (2013). Curriculum-based measurement of oral reading: Multi-study evaluation of schedule, duration, and dataset quality on progress monitoring outcomes. Journal of School Psychology, 51(1), 19–57. https://doi.org/10.1016/j.jsp.2012.11.001</bibtext> </blist> <blist> <bibl id="bib6" idref="ref43" type="bt">6</bibl> <bibtext> Cummings K. D., Park Y., Bauer Schaper H. A. (2013). Form effects on DIBELS Next oral reading fluency progress-monitoring passages. Assessment for Effective Intervention, 38(2), 91–104. https://doi.org/10.1177/1534508412447010</bibtext> </blist> <blist> <bibl id="bib7" idref="ref1" type="bt">7</bibl> <bibtext> Deno S. L. (1985). Curriculum-based measurement: The emerging alternative. Exceptional Children, 52(3), 219–232. https://doi.org/10.1177/001440298505200303</bibtext> </blist> <blist> <bibl id="bib8" idref="ref15" type="bt">8</bibl> <bibtext> Deno S. L., Fuchs L. S. (1987). Developing curriculum-based measurement systems for data-based special education problem solving. Focus on Exceptional Children, 19(8), 1–16.</bibtext> </blist> <blist> <bibl id="bib9" idref="ref34" type="bt">9</bibl> <bibtext> Deno S. L., Fuchs L. S., Marston D., Shin J. (2001). Using curriculum-based measurement to establish growth standards for students with learning disabilities. School Psychology Review, 30(4), 507–524. https://doi.org/10.1080/02796015.2001.12086131</bibtext> </blist> <blist> <bibtext> Espin C. A., Saab N., Pat-El R., Boender P., van der Veen J. (2018). Curriculum-based measurement progress data: Effects of graph pattern on ease of interpretation. Zeitschrift für Erziehungswissenschaft/Journal of Pedagogical Science, 21, 767–792. https://doi.org/10.1007/s11618-018-0836-9</bibtext> </blist> <blist> <bibtext> Espin C. A., van den Bosch R. M., van der Liende M., Rippe R. C., Beutick M., Langa A., Mol S. E. (2021). A systematic review of CBM professional development materials: Are teachers receiving sufficient instruction in data-based decision-making? Journal of Learning Disabilities, 54(4), 256–268. https://doi.org/10.1177/0022219421997103</bibtext> </blist> <blist> <bibtext> Espin C. A., Wayman M. M., Deno S. L., McMaster K. L., de Rooij M. (2017). Data-based decision-making: Developing a method for capturing teachers' understanding of CBM graphs. Learning Disabilities Research & Practice, 32(1), 8–21. https://doi.org/10.1111/ldrp.12123</bibtext> </blist> <blist> <bibtext> Filderman M. J., Toste J. R. (2018). Decisions, decisions, decisions: Using data to make instructional decisions for struggling readers. TEACHING Exceptional Children, 50(3), 130–140. https://doi.org/10.1177/0040059917740701</bibtext> </blist> <blist> <bibtext> Filderman M. J., Toste J. R., Didion L. A., Peng P., Clemens N. H. (2018). Data-based decision making in reading interventions: A synthesis and meta-analysis of the effects for struggling readers. The Journal of Special Education, 52(3), 174–187. https://doi.org/10.1177/0022466918790001</bibtext> </blist> <blist> <bibtext> Flynn L. J., Zheng X., Swanson H. L. (2012). Instructing struggling older readers: A selective meta-analysis of intervention research. Learning Disabilities Research & Practice, 27(1), 21–32. https://doi.org/10.1111/j.1540-5826.2011.00347.x</bibtext> </blist> <blist> <bibtext> Friel S. N., Curcio F. R., Bright G. W. (2001). Making sense of graphs: Critical factors influencing comprehension and instructional implications. Journal for Research in Mathematics Education, 32(2), 124–158. https://doi.org/10.2307/749671</bibtext> </blist> <blist> <bibtext> Fry E., Toste J. R., Feuer B., Espin C. A. (2023). A systematic review of CBM content in practitioner-focused journals: Do we talk about instructional decision-making? Journal of Learning Disabilities. Advance online publication. https://doi.org/10.1177/00222194231215031</bibtext> </blist> <blist> <bibtext> Fuchs L. S., Fuchs D. (1989). Enhancing curriculum-based measurement through computer applications: Review of research and practice. School Psychology Review, 18(3), 317–327. https://doi.org/10.1080/02796015.1989.12085429</bibtext> </blist> <blist> <bibtext> Fuchs L. S., Fuchs D., Hamlett C. L., Stecker P. M. (2021). Bringing data-based individualization to scale: A call for the next-generation technology of teacher supports. Journal of Learning Disabilities, 54(5), 319–333. https://doi.org/10.1177/0022219420950654</bibtext> </blist> <blist> <bibtext> Gleason P., Crissey S., Chojnacki G., Zukiewicz M., Silva T., Costelloe S., O'Reilly F., Johnson E. (2019). Evaluation of support for using student data to inform teachers' instruction (NCEE 2019-4008). National Center for Education Evaluation and Regional Assistance, U.S. Department of Education.</bibtext> </blist> <blist> <bibtext> Gotcher N. (2011). Effects of presentation modality on teachers' data interpretation accuracy and perceptions of intervention and consultant effectiveness [Unpublished doctoral dissertation]. Oklahoma State University.</bibtext> </blist> <blist> <bibtext> Hall C., Dahl-Leonard K., Cho E., Solari E. J., Capin P., Conner C. L., Kehoe K. F. (2023). Forty years of reading intervention research for elementary students with or at risk for dyslexia: A systematic review and meta-analysis. Reading Research Quarterly, 58(2), 285–312. https://doi.org/10.1002/rrq.477</bibtext> </blist> <blist> <bibtext> Hasbrouck J., Tindal G. (2017). An update to compiled ORF norms (Technical Report No. 1702). Behavioral Research and Teaching, University of Oregon.</bibtext> </blist> <blist> <bibtext> The IRIS Center. (2015). Intensive intervention (part 2): Collecting and analyzing data for data-based individualization; Page 4: Analyzing progress monitoring data. https://iris.peabody.vanderbilt.edu/module/dbi2/cresource/q2/p04/#content</bibtext> </blist> <blist> <bibtext> Jenkins J. R., Fuchs L. S., Van Den Broek P., Espin C., Deno S. L. (2003). Sources of individual differences in reading comprehension and reading fluency. Journal of Educational Psychology, 95(4), 719–729. https://doi.org/10.1037/0022-0663.95.4.719</bibtext> </blist> <blist> <bibtext> Jung P.-G., McMaster K. L., Kunkel A. K., Shin J., Stecker P. M. (2018). Effects of Data-Based Individualization for students with intensive learning needs: A meta-analysis. Learning Disabilities Research & Practice, 33(3), 144–155. https://doi.org/10.1111/ldrp.12172</bibtext> </blist> <blist> <bibtext> Klapproth F. (2018). Biased predictions of students' future achievement: An experimental study on pre-service teachers' interpretation of curriculum-based measurement graphs. Studies in Educational Evaluation, 59, 67–75. https://doi.org/10.1016/j.stueduc.2018.03.004</bibtext> </blist> <blist> <bibtext> National Center on Intensive Intervention. (2013). Data-based individualization: A framework for intensive intervention. Office of Special Education, U.S. Department of Education.</bibtext> </blist> <blist> <bibtext> National Center on Intensive Intervention. (n.d.). Reading progress monitoring and instructional decision-making. https://intensiveintervention.org/reading-course-progress-monitoring-reading</bibtext> </blist> <blist> <bibtext> Nese J. F., Biancarosa G., Anderson D., Lai C. F., Alonzo J., Tindal G. (2012). Within-year oral reading fluency with CBM: A comparison of models. Reading and Writing, 25, 887–915. https://doi.org/10.1007/s11145-011-9304-0</bibtext> </blist> <blist> <bibtext> Nese J. F., Biancarosa G., Cummings K., Kennedy P., Alonzo J., Tindal G. (2013). In search of average growth: Describing within-year oral reading fluency growth across Grades 1–8. Journal of School Psychology, 51(5), 625–642. https://doi.org/10.1016/j.jsp.2013.05.006</bibtext> </blist> <blist> <bibtext> Newell K. W., Christ T. J. (2017). Novice interpretations of progress monitoring graphs: Extreme values and graphical aids. Assessment for Effective Intervention, 42(4), 224–236. https://doi.org/10.1177/1534508417694855</bibtext> </blist> <blist> <bibtext> Shepley C., Lane J. D., Graley D. (2023). Progress monitoring data for learners with disabilities: Professional perceptions and visual analysis of effects. Remedial and Special Education, 44(4), 283–293. https://doi.org/10.1177/07419325221128907</bibtext> </blist> <blist> <bibtext> Stecker P. M., Fuchs L. S., Fuchs D. (2005). Using curriculum-based measurement to improve student achievement: Review of research. Psychology in the Schools, 42(8), 795–819. https://doi.org/10.1002/pits.20113</bibtext> </blist> <blist> <bibtext> Stecker P. M., Lembke E. S. (2011). Advanced applications of CBM in reading (K-6): Instructional decision-making strategies manual. National Center on Student Progress Monitoring.</bibtext> </blist> <blist> <bibtext> Torgesen J. K. (2006). Recent discoveries from research on remedial interventions for children with dyslexia. In Snowling M., Hulme C. (Eds.), The science of reading: A handbook (pp. 521–537). Blackwell Publishers.</bibtext> </blist> <blist> <bibtext> Toste J. R., Fry E., Furjanic D., Espin C. A. (2024). Reading of academic progress graphs: A systematic review of graph interpretation studies [Manuscript submitted for publication].</bibtext> </blist> <blist> <bibtext> van den Bosch R. M., Espin C. A., Chung S., Saab N. (2017). Data-based decision-making: Teachers' comprehension of curriculum-based measurement progress-monitoring graphs. Learning Disabilities Research & Practice, 32(1), 46–60. https://doi.org/10.1111/ldrp.12122</bibtext> </blist> <blist> <bibtext> Van Norman E. R., Christ T. J. (2016). How accurate are interpretations of curriculum-based measurement progress monitoring data? Visual analysis versus decision rules. Journal of School Psychology, 58, 41–55. https://doi.org/10.1016/j.jsp.2016.07.003</bibtext> </blist> <blist> <bibtext> Wagner D. L., Hammerschmidt-Snidarich S. M., Espin C. A., Seifert K., McMaster K. L. (2017). Pre-service teachers' interpretation of CBM progress monitoring data. Learning Disabilities Research & Practice, 32(1), 22–31. https://doi.org/10.1111/ldrp.12125</bibtext> </blist> <blist> <bibtext> Zeuch N., Förster N., Souvignier E. (2017). Assessing teachers' competencies to read and interpret graphs from learning progress assessment: Results from tests and interviews. Learning Disabilities Research & Practice, 3(1), 61–70. https://doi.org/10.1111/ldrp.12126</bibtext> </blist> </ref> <ref id="AN0181621033-28"> <title> Footnotes </title> <blist> <bibtext> The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.</bibtext> </blist> <blist> <bibtext> This research was supported in part by the U.S. Department of Education, Institute of Education Sciences, through grant R324A190126 to The University of Texas at Austin. Nothing in this paper necessarily reflects the positions or policies of the agency and no endorsement by it should be inferred.</bibtext> </blist> <blist> <bibtext> Jessica R. Toste</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibtext>https://orcid.org/0000-0002-6327-0054 Nathan H. Clemens</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibtext>https://orcid.org/0000-0002-8361-1303 Erica Fry</bibtext> </blist> <blist> <bibtext>Graph https://orcid.org/0009-0008-9393-1408</bibtext> </blist> </ref> <aug> <p>By Jessica R. Toste; Marissa J. Filderman; Nathan H. Clemens and Erica Fry</p> <p>Reported by Author; Author; Author; Author</p> </aug> <nolink nlid="nl1" bibid="bib28" firstref="ref2"></nolink> <nolink nlid="nl2" bibid="bib14" firstref="ref5"></nolink> <nolink nlid="nl3" bibid="bib26" firstref="ref6"></nolink> <nolink nlid="nl4" bibid="bib19" firstref="ref7"></nolink> <nolink nlid="nl5" bibid="bib12" firstref="ref8"></nolink> <nolink nlid="nl6" bibid="bib38" firstref="ref9"></nolink> <nolink nlid="nl7" bibid="bib40" firstref="ref10"></nolink> <nolink nlid="nl8" bibid="bib41" firstref="ref11"></nolink> <nolink nlid="nl9" bibid="bib34" firstref="ref16"></nolink> <nolink nlid="nl10" bibid="bib18" firstref="ref17"></nolink> <nolink nlid="nl11" bibid="bib13" firstref="ref19"></nolink> <nolink nlid="nl12" bibid="bib35" firstref="ref20"></nolink> <nolink nlid="nl13" bibid="bib16" firstref="ref23"></nolink> <nolink nlid="nl14" bibid="bib37" firstref="ref28"></nolink> <nolink nlid="nl15" bibid="bib10" firstref="ref29"></nolink> <nolink nlid="nl16" bibid="bib27" firstref="ref30"></nolink> <nolink nlid="nl17" bibid="bib32" firstref="ref31"></nolink> <nolink nlid="nl18" bibid="bib39" firstref="ref32"></nolink> <nolink nlid="nl19" bibid="bib30" firstref="ref35"></nolink> <nolink nlid="nl20" bibid="bib21" firstref="ref38"></nolink> <nolink nlid="nl21" bibid="bib24" firstref="ref44"></nolink> <nolink nlid="nl22" bibid="bib29" firstref="ref45"></nolink> <nolink nlid="nl23" bibid="bib33" firstref="ref50"></nolink> <nolink nlid="nl24" bibid="bib25" firstref="ref62"></nolink> <nolink nlid="nl25" bibid="bib15" firstref="ref63"></nolink> <nolink nlid="nl26" bibid="bib22" firstref="ref64"></nolink> <nolink nlid="nl27" bibid="bib36" firstref="ref65"></nolink> <nolink nlid="nl28" bibid="bib23" firstref="ref66"></nolink> <nolink nlid="nl29" bibid="bib11" firstref="ref69"></nolink> <nolink nlid="nl30" bibid="bib17" firstref="ref70"></nolink> <nolink nlid="nl31" bibid="bib20" firstref="ref71"></nolink>
Header DbId: eric
DbLabel: ERIC
An: EJ1453775
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Graph Out Loud: Pre-Service Teachers' Data Decisions and Interpretations of CBM Progress Graphs
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Jessica+R%2E+Toste%22">Jessica R. Toste</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-6327-0054">0000-0002-6327-0054</externalLink>)<br /><searchLink fieldCode="AR" term="%22Marissa+J%2E+Filderman%22">Marissa J. Filderman</searchLink><br /><searchLink fieldCode="AR" term="%22Nathan+H%2E+Clemens%22">Nathan H. Clemens</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-8361-1303">0000-0002-8361-1303</externalLink>)<br /><searchLink fieldCode="AR" term="%22Erica+Fry%22">Erica Fry</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0008-9393-1408">0009-0008-9393-1408</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Learning+Disabilities%22"><i>Journal of Learning Disabilities</i></searchLink>. 2025 58(1):33-45.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 13
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Institute of Education Sciences (ED)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R324A190126
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Preservice+Teachers%22">Preservice Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Use%22">Data Use</searchLink><br /><searchLink fieldCode="DE" term="%22Decision+Making%22">Decision Making</searchLink><br /><searchLink fieldCode="DE" term="%22Progress+Monitoring%22">Progress Monitoring</searchLink><br /><searchLink fieldCode="DE" term="%22Visual+Aids%22">Visual Aids</searchLink><br /><searchLink fieldCode="DE" term="%22Special+Education+Teachers%22">Special Education Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Measurement+Techniques%22">Measurement Techniques</searchLink><br /><searchLink fieldCode="DE" term="%22Protocol+Analysis%22">Protocol Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Verbal+Communication%22">Verbal Communication</searchLink><br /><searchLink fieldCode="DE" term="%22Reading+Difficulties%22">Reading Difficulties</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Texas%22">Texas</searchLink><br /><searchLink fieldCode="DE" term="%22Oregon%22">Oregon</searchLink><br /><searchLink fieldCode="DE" term="%22Pennsylvania%22">Pennsylvania</searchLink><br /><searchLink fieldCode="DE" term="%22Virginia%22">Virginia</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/00222194241231768
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0022-2194<br />1538-4780
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Data-based instruction (DBI) is a process in which teachers use progress data to make ongoing instructional decisions for students with learning disabilities. Curriculum-based measurement (CBM) is a common form of progress monitoring, and CBM data are placed on a graph to guide decision-making. Despite the central role that graph interpretation plays in the successful implementation of DBI, relatively little attention has been devoted to investigating this skill among special education teachers. In the present study, we examined the data decisions of 32 U.S. pre-service special education teachers (29 females and 3 males). Participants viewed data presented sequentially on CBM progress graphs and used a think-aloud procedure to explain their reasoning each time they indicated they would make instructional changes. We also asked participants to make the same type of decisions in response to static CBM progress graphs depicting 10 weeks of data. Overall, there was inconsistency in pre-service teachers' responses related to "when" or "why" they would make an instructional change. Decisions were often influenced by graph-related features, such as variability in the data. Furthermore, responses suggested misunderstandings that led to premature instructional change decisions and reliance on individual data points.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1453775
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1453775
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/00222194241231768
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 13
        StartPage: 33
    Subjects:
      – SubjectFull: Preservice Teachers
        Type: general
      – SubjectFull: Data Use
        Type: general
      – SubjectFull: Decision Making
        Type: general
      – SubjectFull: Progress Monitoring
        Type: general
      – SubjectFull: Visual Aids
        Type: general
      – SubjectFull: Special Education Teachers
        Type: general
      – SubjectFull: Teaching Methods
        Type: general
      – SubjectFull: Measurement Techniques
        Type: general
      – SubjectFull: Protocol Analysis
        Type: general
      – SubjectFull: Verbal Communication
        Type: general
      – SubjectFull: Reading Difficulties
        Type: general
      – SubjectFull: Texas
        Type: general
      – SubjectFull: Oregon
        Type: general
      – SubjectFull: Pennsylvania
        Type: general
      – SubjectFull: Virginia
        Type: general
    Titles:
      – TitleFull: Graph Out Loud: Pre-Service Teachers' Data Decisions and Interpretations of CBM Progress Graphs
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Jessica R. Toste
      – PersonEntity:
          Name:
            NameFull: Marissa J. Filderman
      – PersonEntity:
          Name:
            NameFull: Nathan H. Clemens
      – PersonEntity:
          Name:
            NameFull: Erica Fry
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 0022-2194
            – Type: issn-electronic
              Value: 1538-4780
          Numbering:
            – Type: volume
              Value: 58
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Journal of Learning Disabilities
              Type: main
ResultId 1