View in EDS HTML Full Text PDF Full Text

A Systematic Review of CBM Content in Practitioner-Focused Journals: Do We Talk about Instructional Decision-Making?

Saved in:
Bibliographic Details
Title: A Systematic Review of CBM Content in Practitioner-Focused Journals: Do We Talk about Instructional Decision-Making?
Language: English
Authors: Erica C. Fry (ORCID 0009-0008-9393-1408), Jessica R. Toste (ORCID 0000-0002-6327-0054), Beth R. Feuer, Christine A. Espin (ORCID 0000-0003-0407-5897)
Source: Journal of Learning Disabilities. 2024 57(5):275-290.
Availability: SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Peer Reviewed: Y
Page Count: 16
Publication Date: 2024
Sponsoring Agency: Institute of Education Sciences (ED)
Office of Special Education Programs (OSEP) (ED/OSERS)
Contract Number: R324A190126
Document Type: Journal Articles
Information Analyses
Descriptors: Evidence Based Practice, Decision Making, Curriculum Based Assessment, Learning Disabilities, Data Collection, Content Analysis, Data Use, Individualized Education Programs
DOI: 10.1177/00222194231215031
ISSN: 0022-2194
1538-4780
Abstract: Data-based decision-making (DBDM) using curriculum-based measurement (CBM) data has demonstrated effectiveness in improving academic achievement for students with or at risk for learning disability. Despite substantial evidence supporting DBDM, its use is not common practice for many educators, even those who regularly collect CBM data. One explanation for its lack of widespread use is that educators may not receive adequate training in the DBDM aspects of CBM. Espin et al. examined the extent to which DBDM is represented in CBM professional development (PD) materials and found that the topic was significantly underrepresented (12% to 14% of CBM PD material content) compared with other CBM topics. The purpose of this study was to conduct a conceptual replication of the Espin et al. systematic review through an analysis of CBM content in practitioner journal articles. The present review includes 29 practitioner articles coded to the four CBM categories used in the Espin et al. study: (a) general CBM information, (b) conducting CBM, (c) data-based decision-making, and (d) other. Results revealed a pattern similar to the one found by Espin et al. with approximately 18% of the content of practitioner articles on CBM devoted to the topic of decision-making. These findings strengthen the recommendation from Espin et al. for increased attention to DBDM in CBM training materials.
Abstractor: As Provided
IES Funded: Yes
Entry Date: 2024
Accession Number: EJ1440408
Database: ERIC
Full text is not displayed to guests.
FullText Links:
  – Type: pdflink
    Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwEXSysjwPdVtHISnVjKh8CSAAAA4TCB3gYJKoZIhvcNAQcGoIHQMIHNAgEAMIHHBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDDJOQiKFwXGKaxeMcQIBEICBmajSZCryJleHWDa_LKeRtSmiMIch4XId9HwiPMxW62P6xtehMOIHn3JY5rU7oc544Le0QIXuCeYSpus6Ie7d2mNMc7FNRDukoQM4eKzNa48YNljn7n_rqU8b-O2S9RQoBR5wZgOMbTWIVDOsbjLrtSwGUznGCKggo7BJTFMxMefYU4spXl3mHLZ3wSEELdILxSLqOpIk2uBptw==
Text:
  Availability: 1
  Value: <anid>AN0179766624;led01sep.24;2024Sep24.05:55;v2.2.500</anid> <title id="AN0179766624-1">A Systematic Review of CBM Content in Practitioner-Focused Journals: Do We Talk About Instructional Decision-Making? </title> <p>Data-based decision-making (DBDM) using curriculum-based measurement (CBM) data has demonstrated effectiveness in improving academic achievement for students with or at risk for learning disability. Despite substantial evidence supporting DBDM, its use is not common practice for many educators, even those who regularly collect CBM data. One explanation for its lack of widespread use is that educators may not receive adequate training in the DBDM aspects of CBM. Espin et al. examined the extent to which DBDM is represented in CBM professional development (PD) materials and found that the topic was significantly underrepresented (12% to 14% of CBM PD material content) compared with other CBM topics. The purpose of this study was to conduct a conceptual replication of the Espin et al. systematic review through an analysis of CBM content in practitioner journal articles. The present review includes 29 practitioner articles coded to the four CBM categories used in the Espin et al. study: (a) general CBM information, (b) conducting CBM, (c) data-based decision-making, and (d) other. Results revealed a pattern similar to the one found by Espin et al. with approximately 18% of the content of practitioner articles on CBM devoted to the topic of decision-making. These findings strengthen the recommendation from Espin et al. for increased attention to DBDM in CBM training materials.</p> <p>Keywords: curriculum-based measurement; data-based decision-making; content analysis</p> <p>For students with or at risk of learning disability, the use of progress monitoring data is essential for timely evaluation of the effectiveness of academic interventions and responsive, appropriate instructional decision-making. Federal special education legislation ([<reflink idref="bib47" id="ref1">47</reflink>]) and subsequent litigation (e.g., [<reflink idref="bib14" id="ref2">14</reflink>]) have established a clear mandate for educators to monitor, document, and respond to student progress. To do so, educators commonly collect curriculum-based measurement (CBM) data for progress monitoring and reporting purposes, but previous research indicates that they are far less likely to use CBM data to guide their instructional decision-making.</p> <p>Data-based instruction (DBI), also referred to as data-based individualization ([<reflink idref="bib30" id="ref3">30</reflink>]; [<reflink idref="bib61" id="ref4">61</reflink>]) or data-based program modification ([<reflink idref="bib11" id="ref5">11</reflink>]), is a process for adjusting interventions by responding to CBM data. The process involves implementation of an intervention program and ongoing progress monitoring with a valid and reliable system, such as CBM. When data indicate a student is not making adequate progress in response to the intervention, the next step is to use diagnostic assessment data to inform an adjustment to the intervention, with the goal of increasing the rate of student progress. After an adjustment is implemented, the process is repeated to continue monitoring student progress. Meta-analyses of DBI effectiveness support its use for improving academic performance across content areas ([<reflink idref="bib48" id="ref6">48</reflink>]; [<reflink idref="bib52" id="ref7">52</reflink>]).</p> <p>One critical component of the DBI process is data-based decision-making (DBDM), using student data to directly inform individual instructional decisions. Despite the demonstrated effectiveness of using CBM data for DBDM, many educators lack the knowledge and skills needed to engage in this type of instructional decision-making (e.g., [<reflink idref="bib16" id="ref8">16</reflink>]; [<reflink idref="bib62" id="ref9">62</reflink>]; [<reflink idref="bib69" id="ref10">69</reflink>]; [<reflink idref="bib71" id="ref11">71</reflink>]). Fortunately, when educators receive CBM training that addresses components of DBDM, their knowledge and skills related to data use may improve ([<reflink idref="bib20" id="ref12">20</reflink>]; [<reflink idref="bib36" id="ref13">36</reflink>]; [<reflink idref="bib77" id="ref14">77</reflink>]). Research has demonstrated positive effects when training focuses on essential CBM content—collecting, graphing, and interpreting CBM data as well as linking data to instruction (i.e., DBDM; [<reflink idref="bib59" id="ref15">59</reflink>]; [<reflink idref="bib71" id="ref16">71</reflink>], [<reflink idref="bib72" id="ref17">72</reflink>]). What remains unclear is the extent to which this CBM content, particularly DBDM, is explicitly taught in educator preparation programs and professional development (PD) training opportunities.</p> <hd id="AN0179766624-2">What Is CBM?</hd> <p>In the late 1970s and 1980s, Stanley Deno and a team of researchers at the University of Minnesota worked to develop an assessment system that would allow educators to quickly interpret student performance data and identify when there is a need for instructional adjustment ([<reflink idref="bib8" id="ref18">8</reflink>]). The goal was not simply to quantify and report student performance, but rather to use assessment as a tool to directly inform instruction. They aimed to develop a system that produced reliable and valid scores, could be easily understood, and was simple, efficient, and inexpensive to administer. Deno and his colleagues developed a system that not only met these criteria but also demonstrated effectiveness as a tool that educators were able to use to effect greater student achievement ([<reflink idref="bib10" id="ref19">10</reflink>]; [<reflink idref="bib9" id="ref20">9</reflink>]; [<reflink idref="bib25" id="ref21">25</reflink>], [<reflink idref="bib26" id="ref22">26</reflink>]).</p> <p>The system incorporates parallel forms of measures that are aligned with the curriculum and are of equal difficulty to allow for detection of small changes in performance over time. Since this early work, CBM in reading has been established as a standardized, technically adequate, formative assessment system with reliability ranging from.82 to.99 (e.g., [<reflink idref="bib50" id="ref23">50</reflink>]; [<reflink idref="bib55" id="ref24">55</reflink>]; [<reflink idref="bib66" id="ref25">66</reflink>]). Furthermore, reading CBM data are strongly predictive of overall reading performance and aligned with standardized test scores (e.g., [<reflink idref="bib15" id="ref26">15</reflink>]; [<reflink idref="bib31" id="ref27">31</reflink>]; [<reflink idref="bib76" id="ref28">76</reflink>]). In fact, scores from CBM reading measures have been found to be accurate for screening and identifying children as young as first grade as at risk of failing standardized reading assessments in later grades ([<reflink idref="bib44" id="ref29">44</reflink>]).</p> <p>While early CBM research focused primarily on reading, measures have since been developed across content and skill areas. Reported reliability and validity estimates of CBM assessment vary somewhat across these areas. For example, in mathematics, CBM measuring number sense has demonstrated reliability ranging from.78 to.99 and validity ranging from.49 to.93 ([<reflink idref="bib5" id="ref30">5</reflink>]). In the elementary grade levels, mathematics computation CBM have demonstrated reliability and validity above.90 (e.g., [<reflink idref="bib50" id="ref31">50</reflink>]; [<reflink idref="bib55" id="ref32">55</reflink>]). Mean criterion validity of.55 has been reported in meta-analyses of writing CBM assessments ([<reflink idref="bib67" id="ref33">67</reflink>]). Finally, a meta-analysis of science and social studies CBM found significant heterogeneity among studies and alternate form reliability between.21 and.89 ([<reflink idref="bib6" id="ref34">6</reflink>]). Although variability exists across content and skill areas, there is evidence that CBM is an effective option for collecting academic progress data and informing instruction ([<reflink idref="bib4" id="ref35">4</reflink>]; [<reflink idref="bib34" id="ref36">34</reflink>]; [<reflink idref="bib73" id="ref37">73</reflink>]).</p> <p>For the purposes of DBI, CBM data are graphed and visually analyzed. Each CBM probe produces a single datapoint, a snapshot of student performance at a specific moment in time. Once baseline data are collected, a goal is developed using one of multiple possible strategies that take into account factors such as performance at baseline, length of the intervention, achievement norms, and anticipated rate of growth ([<reflink idref="bib28" id="ref38">28</reflink>]; [<reflink idref="bib46" id="ref39">46</reflink>]). The next step is to plot baseline data and the long-range achievement goal on a graph where the x-axis displays time and the y-axis displays scores. A line drawn from baseline to the goal serves as an aim line (sometimes referred to as a goal line), modeling the expected performance at each data collection point if the student is to reach the goal according to the predetermined timeline. As data are plotted over time, a trendline may be added to show the student's predicted trajectory based on all the data collected so far.</p> <p>Essential knowledge and skills are required not only to administer, collect, graph, and interpret CBM data but also to engage in instructional decision-making in response to that data. There are two key decisions that educators make while collecting CBM progress data: <emph>when</emph> there is a need to adjust instruction and, following from that decision, <emph>how</emph> to adjust instruction ([<reflink idref="bib61" id="ref40">61</reflink>]). To determine when an instructional adjustment is needed, educators engage in visual analysis of CBM graphs and apply decision rules (e.g., [<reflink idref="bib74" id="ref41">74</reflink>]). How does the slope of the trendline compare to the slope of the aim line? At the intervention's projected end date, is the trendline above, below, or similar to the aim line? How much variability exists within the plot of data points? Do the data vary consistently about the aim line, or do multiple consecutive points fall either above or below the line? If there is a need to adjust instruction, educators must consider how to do so in a way that meets the student's needs ([<reflink idref="bib30" id="ref42">30</reflink>]). There is likely a need to consider additional diagnostic data to supplement the CBM progress data ([<reflink idref="bib65" id="ref43">65</reflink>]). For example, if the CBM graph displays three consecutive data points falling below the projected aim line, the educator may determine that the intervention is not adequately meeting the student's needs and it is time to adjust instruction. To determine how to do this, the educator may review their anecdotal behavior notes and decide to collect antecedent-behavior-consequence (ABC) data to better understand how they can intensify instruction for this student. Taken together, the educator may decide to incorporate a 60-s movement break during the 30-min intervention. They will implement this change, while continuing to collect and graph CBM progress data to monitor the student's response over time.</p> <hd id="AN0179766624-3">Educators' Use of CBM for Instructional Decision-Making</hd> <p>CBM is commonly used for tracking and reporting student progress toward annual goals on Individualized Education Programs (IEPs) and for universal screening to determine which students receive targeted or intensive instruction within a multi-tiered system of supports (MTSS). These uses of CBM are relatively straightforward—they generally make use of CBM data collected at a single timepoint and do not require expertise beyond the knowledge necessary for reliable administration and scoring. However, DBI requires a broader range of skills that support frequent, ongoing collection and interpretation of progress data for students who have the most persistent and severe academic difficulties.</p> <p>To improve academic outcomes for students who require targeted or intensive intervention and support, practitioners must develop expertise in reading and interpreting CBM graphs for the purpose of making effective instructional decisions. Manualized CBM procedures generally provide guidance for graph interpretation, but educators may find themselves lacking the expertise to engage in this type of DBDM. For example, [<reflink idref="bib75" id="ref44">75</reflink>] noted that educators were generally unable to "bridge the divide between using data to identify students in need of help and using data to modify instruction" (p. 296). That is, educators have a wealth of high-quality academic achievement data and little clarity on what to do with it.</p> <p>A consistent and worrisome finding to emerge from both general and special education research is that educators have difficulty using data to guide instructional decision-making (e.g., [<reflink idref="bib16" id="ref45">16</reflink>]; [<reflink idref="bib54" id="ref46">54</reflink>]; [<reflink idref="bib71" id="ref47">71</reflink>]). Although CBM graphs appear relatively uncomplicated, research on graph comprehension in general reveals that reading even simple graphs can be challenging (see [<reflink idref="bib24" id="ref48">24</reflink>]). Graph interpretation is subject to a variety of cognitive errors such as being influenced by prior knowledge, seeing relationships in the data that do not exist, and confusing slope with height ([<reflink idref="bib37" id="ref49">37</reflink>]). To become proficient in the use of CBM for DBDM, educators must have access to high-quality training opportunities and materials.</p> <hd id="AN0179766624-4">Professional Training Materials</hd> <p>Although some special educators receive CBM training in their educator preparation programs, many enter the profession without training in research-based practices ([<reflink idref="bib1" id="ref50">1</reflink>]; [<reflink idref="bib51" id="ref51">51</reflink>]), including CBM. Educators whose preparation did not include training in CBM may subsequently receive in-service PD in CBM. Given that the ultimate purpose of collecting CBM progress data for students with and at risk for learning disability is to have valid and reliable data to guide <emph>instructional decision-making</emph>, one might reasonably assume that CBM training materials for special education educators would include substantial information on DBDM. Effective CBM implementation relies upon developing educators' knowledge and skill in multiple areas; DBDM is arguably among the most critical for intensifying instruction.</p> <p>In their 2021 systematic review, Espin and colleagues examined the proportion of attention devoted to DBDM compared with other aspects of CBM in PD training materials. They calculated the distribution of CBM information across four categories: general information, conducting CBM, DBDM, and other (e.g., CBM used for screening or RTI placement). Next, they compared these proportions to two alternate distributions: that which would be observed if the four categories were given equal attention and the distribution recommended by a panel of experienced CBM trainers. [<reflink idref="bib17" id="ref52">17</reflink>] found that little emphasis was placed on DBDM relative to other CBM topics in the PD materials that they reviewed. The actual proportion (12% for presentations, 14% for manuals and books) was significantly less than would be expected from either an equal distribution (25%) or the proportion recommended by experienced trainers (34%). While these findings suggested a lack of training focused on DBDM, the authors noted a need to replicate the study with other materials wherein educators may access CBM content. The present review attempts to do just that.</p> <p>To identify sources used by educators to gain information about best practices, the [<reflink idref="bib13" id="ref53">13</reflink>] conducted a survey of more than 500 educators from a nationally representative K–12 sample. Educators reported that they most frequently relied on content from PD (78%), followed by word of mouth or recommendations from colleagues (71%), educator-focused websites (50%), and social media (40%). In addition, more than a quarter of respondents (26%) reported accessing information about best practices through practitioner-focused journals. A similar survey of more than 1,300 educators, conducted by the University of Virginia's Jefferson Education Exchange, asked educators which channels they use to access research. At least 24% of respondents reported accessing information through a subscription to an academic journal ([<reflink idref="bib23" id="ref54">23</reflink>]). These recent surveys suggest that academic journals represent a significant source of professional learning and are likely accessed by approximately one-quarter of U.S. educators. Considering that this is an outlet frequently used by special education researchers to translate research, there is a need to explore CBM content within practitioner-focused journals.</p> <hd id="AN0179766624-5">Study Purpose</hd> <p>The purpose of the present systematic review was to conduct a conceptual replication of [<reflink idref="bib17" id="ref55">17</reflink>]. Specifically, we sought to extend their findings by examining the extent to which DBDM is addressed in CBM-focused articles written for a practitioner audience. While [<reflink idref="bib17" id="ref56">17</reflink>] focused on professional development materials, this study focuses on information presented in practitioner-oriented journals. Many educators report obtaining information from journals, and although they also report getting information from other sources (e.g., recommendations from colleagues, websites, and social media), it is likely that the information from these other sources is also based in part on information published in journals. Because so many educators lack knowledge and skill in DBDM, it is important to understand the representation of CBM content across the various sources used to gather information.</p> <p>Increasingly, there are investments being made in effective dissemination and knowledge translation efforts of educational research fundings (e.g., [<reflink idref="bib60" id="ref57">60</reflink>]). Writing for practitioner audiences remains a key outlet for such efforts; however, little is known about the content or quality of these resources. The present review contributes to our understanding of how current research dissemination efforts may support educators' professional learning about using CBM data for DBDM. We anticipate the findings of the present review will reflect trends similar to those identified by [<reflink idref="bib17" id="ref58">17</reflink>], although we do not present hypotheses due to the exploratory nature of this study. We sought to address three research questions:</p> <p></p> <ulist> <item> <bold> Research Question 1: </bold> What proportion of information is devoted to DBDM, relative to other content categories, in CBM practitioner-focused articles?</item> <p></p> <item> <bold> Research Question 2: </bold> Does the proportion of information devoted to DBDM differ from what would be expected if information were equally distributed across major CBM content categories?</item> <p></p> <item> <bold> Research Question 3: </bold> When DBDM content is included, what is the specificity with which articles address when and how to make instructional decisions using CBM data?</item> </ulist> <hd id="AN0179766624-6">Method</hd> <p></p> <hd id="AN0179766624-7">Search and Selection Process</hd> <p>An overview of the search process is presented in Figure 1. We identified articles to be considered for inclusion through two phases of comprehensive journal searches—an initial search of four practitioner-focused journals, followed by an expanded search of eight additional journals based on expert recommendations. Each phase is described below.</p> <p>Graph: Figure 1. Search and Selection Process.</p> <p>To be eligible for inclusion in the study, articles had to meet the following criteria: (a) published in English, (b) written for a practitioner audience, (c) appeared in an indexed journal, (d) included a "how-to" component, and (e) focused on assessment of academic skills. Articles were deemed to be written for a practitioner audience if the primary purpose was to convey information educators could readily apply to their practice, not to report findings or discuss implications for practice derived from empirical research. Among these practitioner-focused articles, there must have also been a "how-to" component, which we operationalized as a description of how to administer CBM or use CBM data for the purpose of progress monitoring.</p> <hd id="AN0179766624-8">Phase 1: Initial Search of Practitioner-Focused Journals</hd> <p>This systematic review of peer-reviewed special education practitioner journals began with an electronic search of four special education practitioner journals: <emph>Beyond Behavior, Intervention in School and Clinic</emph>, <emph>Learning Disabilities Research & Practice</emph>, and <emph>TEACHING Exceptional Children</emph>. As widely distributed practitioner publications of the Council for Exceptional Children (CEC) and Council for Learning Disabilities (CLD), we anticipated that these were journals special educators would likely access for information on research-based practices, including CBM. Titles and abstracts of articles published between the journal's inception and March 2022 were searched with the terms used by [<reflink idref="bib17" id="ref59">17</reflink>]: <emph>curriculum-based measurement</emph>, <emph>CBM, general outcome measurement, data-based instruction, data-based decision-making, curriculum-based assessment</emph>, and <emph>curriculum-based evaluation</emph>. In addition, we included the following terms to broaden the scope of the search and ensure that all relevant articles were retrieved: <emph>data-based individualization</emph>, <emph>DBI</emph>, <emph>progress monitoring</emph>, and <emph>academic progress monitoring</emph>. The Boolean operator "OR" was entered between each search term to capture all relevant results.</p> <p>To ensure we captured all relevant articles, we conducted a comprehensive search of each journal's publication history, including full-text searches via the publishers' sites and database searches of titles, abstracts, and subject headings with each journal using Education Source and PsycINFO. After deduplication, this search process resulted in 162 articles. Through abstract screening, 63 were excluded for the following reasons: not practitioner-focused (<emph>n</emph> = 20), focused on progress monitoring of behavior rather than academics (<emph>n</emph> = 18), did not discuss any form of progress monitoring (<emph>n</emph> = 18), did not include a "how-to" component (<emph>n</emph> = 5), and focused solely on curriculum-based assessment to the exclusion of CBM (<emph>n</emph> = 2). In total, 99 articles were retrieved for full-text review.</p> <hd id="AN0179766624-9">Phase 2: Expanded Search Based on Expert Recommendations</hd> <p>Our selection of four practitioner journals in Phase 1 was based on the opinions of the research team—and perhaps an assumption that widely distributed journals are accessible to practitioners. Thus, to mitigate these potential limitations, we solicited input from published researchers in the field to conduct an expanded search (Phase 2). To identify additional journals to be searched for relevant articles, the first authors of all articles identified in Phase 1 were contacted. Authors were asked to complete a survey that briefly described the current review, listed the four journals already included, and asked for suggestions of additional journals that were peer-reviewed, indexed in electronic academic databases, and practitioner-focused where special educators would be likely to find information on CBM.</p> <p>In total, 19 authors responded to the survey, collectively recommending an additional 11 journals. To determine whether each journal was peer-reviewed and indexed, we verified each title on ProQuest, through the University library stem, and their own publisher website. Of these journals, three were eliminated as they were not indexed or peer-reviewed, resulting in an additional eight journals: <emph>Assessment for Effective Intervention</emph>, <emph>Contemporary School Psychology</emph>, <emph>Journal of Applied School Psychology</emph>, <emph>Preventing School Failure</emph>, <emph>Psychology in the Schools</emph>, <emph>Remedial and Special Education</emph>, <emph>School Psychology Forum</emph>, and <emph>The Reading Teacher</emph>. These journals were searched using the same procedures described in Phase 1. This search returned 350 results published before March 2022. Of these, 289 were excluded for the following reasons: not practitioner-focused (<emph>n</emph> = 221), did not discuss any form of progress monitoring (<emph>n</emph> = 45), focused on progress monitoring of behavior rather than academics (<emph>n</emph> = 22), and focused solely on curriculum-based assessment (CBA) or curriculum-based evaluation (CBE; <emph>n</emph> = 1). Following the screening process, 61 articles were retrieved for full-text review.</p> <hd id="AN0179766624-10">Full-Text Review</hd> <p>Next, the 160 identified articles (99 from Phase 1 and 61 from Phase 2) were retrieved and reviewed for eligibility based on the established inclusion criteria. Through this process, 131 articles were excluded for the following reasons: did not discuss any form of progress monitoring (<emph>n</emph> = 46), did not include a "how-to" component (<emph>n</emph> = 41), were not practitioner-focused (<emph>n</emph> = 28), focused on progress monitoring of behavior rather than academics (<emph>n</emph> = 11), and focused solely on CBA or CBE (<emph>n</emph> = 5). A total of 29 articles from 5 journals met criteria for inclusion in the present systematic review. For full-text review, two authors independently evaluated each of these 160 articles for inclusion. Reliability between researchers was 93.75%; calculated by dividing the number of articles with agreement (<emph>n</emph> = 150) by the total number of articles. All discrepancies were resolved through discussion to reach consensus.</p> <hd id="AN0179766624-11">Coding Procedures</hd> <p>Prior to coding, we verified that none of the 29 eligible articles had Supplemental files available via the journal website or other service for hosting open materials. We then used Research Electronic Data Capture (REDCap; [<reflink idref="bib41" id="ref60">41</reflink>], [<reflink idref="bib40" id="ref61">40</reflink>]) tools to extract data related to the general features of each article. This information included author(s), journal name, article title, year of publication, content area (e.g., reading, spelling, and math), type of CBM data (e.g., oral reading fluency, digits correct, correct word sequences), presence of a vignette (yes/no), presence of graph(s), content of graph (images only, discussion only, images and discussion of graph), and grade level(s) of focus (elementary, middle school, and high school). We also coded specificity of DBDM content, with each article being assigned two holistic codes: (a) <emph>When</emph> to make an instructional change, and (b) <emph>How</emph> to make an instructional change. In each category, DBDM content was coded as <emph>none</emph> if the article did not mention instructional decision-making, <emph>reference</emph> if instructional decision-making was mentioned but not described, <emph>non-specific guidance</emph> if types of instructional adjustments in response to student data were mentioned (e.g., increase dosage or raise the goal), and <emph>specific guidance</emph> if there was clear explanation for how educators should engage in a decision-making process in response to interpretation of CBM data to inform instructional adjustments. Two researchers independently coded all articles and reliability was calculated at 90%; all discrepancies were discussed until consensus was reached.</p> <p>Next, plain text versions of all 29 articles were prepared and files were imported into NVivo12 for Mac. All text within each article was coded to identify CBM content using a protocol that replicated and extended [<reflink idref="bib17" id="ref62">17</reflink>]: (a) general CBM information, (b) conducting CBM, (c) CBM DBDM, (d) CBM other, (e) non-CBM assessment, and (f) other text. The inclusion of the category <emph>other text</emph> allowed every paragraph to be coded. Table 1 provides an operational definition, examples, and non-examples for each code.</p> <p>Table 1. CBM Content Categories and Definitions.</p> <p>Graph</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th align="left">Code</th><th align="center">Description</th><th align="center">Includes</th><th align="center">Does not include</th></tr></thead><tbody><tr><td>General CBM Information</td><td>General information, CBM background</td><td>Background / explanation of what CBM is; research base for CBM / reference to CBM studies</td><td>Information on non-CBM assessment</td></tr><tr><td>Conducting CBM</td><td>Administering CBM, collecting or graphing CBM data</td><td>Selecting, creating, administering, scoring CBM; graphing CBM data; goal setting</td><td>DBDM or other steps that occur after graphing</td></tr><tr><td>CBM DBDM</td><td>Reading or interpreting CBM graphs, linking data to instruction</td><td>Comparing slopes; comparing data points to goal; data-decision rules; clear link to instruction must be made</td><td>Decision-making that is not based on interpretation of graphed PM data</td></tr><tr><td>CBM Other</td><td>Using CBM for purposes beyond progress monitoring</td><td>Using data to screen and identify students with learning difficulties</td><td>Other forms of (non-PM) data used for screening / identification</td></tr><tr><td>Non-CBM Assessment</td><td>Content focused on other forms of assessment</td><td>CBA, CBE, benchmark exams, educator-made assessments, portfolios</td><td>Progress monitoring data</td></tr><tr><td>Other Text</td><td>Any text not captured in another code</td><td>Background information; organization/purpose of article</td><td>Assessment and collaboration</td></tr></tbody></table> </ephtml> </p> <p>1 <emph>Note.</emph> CBM = curriculum-based measurement; DBDM = Data-based decision-making; CBA = curriculum-based assessment; CBE = curriculum-based evaluation; PM = progress monitoring.</p> <p>Each paragraph of the article was assigned to only one of these six codes. Paragraphs were operationalized as chunks of text visually separated from one another by blank lines. Section headings were coded with the ensuing paragraph, and bulleted lists were coded with the preceding paragraph. Our unit of analysis differed from [<reflink idref="bib17" id="ref63">17</reflink>], who coded an approximate proportion of a page (i.e., 1, 1/2, 1/3, 1/4) devoted to a topic, due to the nature of scholarly articles. One idea is rarely represented by a single sentence; as such, coding at the paragraph-level allowed for capturing the main ideas conveyed within each article. In articles containing a vignette or other narrative example, the content of the vignette was coded separately from the main text of the article to determine whether the proportion of text devoted to each category would vary according to the type of text. Again, two independent researchers completed this qualitative coding and reliability was calculated at 88%, with discrepancies discussed and consensus reached.</p> <hd id="AN0179766624-12">Results</hd> <p></p> <hd id="AN0179766624-13">Article Characteristics</hd> <p>In all, 29 articles met the eligibility criteria for inclusion in the present study (see Table 2). The articles were published between 1990 and 2022 across five journals: <emph>Intervention in School and Clinic</emph> (<emph>n</emph> = 9), <emph>TEACHING Exceptional Children</emph> (<emph>n</emph> = 9), <emph>Preventing School Failure</emph> (<emph>n</emph> = 6), <emph>Assessment for Effective Intervention</emph> (<emph>n</emph> = 3), and <emph>Learning Disabilities Research and Practice</emph> (<emph>n</emph> = 2). Twelve of the articles focused on reading CBM, seven focused on math, four focused on writing, one focused on social studies vocabulary, and the remaining five articles described CBM in multiple content areas. Twenty articles included vignettes, which were coded and analyzed separately from the main text of the article. Analyses required calculation of the total number of words in articles. The 29 articles included a total of 106,784 words—83,152 words in the main text and 23,632 words in the vignettes. The distribution of the total word count is displayed in Tables 3 and 4.</p> <p>Table 2. Characteristics of the Articles from the Search and Selection Process.</p> <p>Graph</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th align="left">Authors</th><th align="center">Year</th><th align="center">Journal</th><th align="center">Content area and focus</th><th align="center">Vignette</th><th align="center">How</th><th align="center">When</th></tr></thead><tbody><tr><td>Busch & Espin</td><td><xref ref-type="bibr" rid="bibr4">2003</xref></td><td>AEI</td><td>VocabularyVocabulary matching as a measure of progress in content areas</td><td>Yes</td><td>Non-specific</td><td>Non-specific</td></tr><tr><td>Fuchs & Fuchs</td><td><xref ref-type="bibr" rid="bibr27">1991</xref></td><td>PSF</td><td>MathematicsOverview of applications of CBM</td><td>Yes</td><td>Specific</td><td>Non-specific</td></tr><tr><td>Fuchs et al.</td><td><xref ref-type="bibr" rid="bibr32">2008</xref></td><td>AEI</td><td>MathematicsIllustrates the systematic curricular sampling approach to formulating CBM systems</td><td>Yes</td><td>Non-specific</td><td>Specific</td></tr><tr><td>Gable & Hendrickson</td><td><xref ref-type="bibr" rid="bibr33">1990</xref></td><td>PSF</td><td>ReadingLinking ORF error analysis to instruction</td><td>Yes</td><td>Reference</td><td>Reference</td></tr><tr><td>Hosp & Hosp</td><td><xref ref-type="bibr" rid="bibr45">2003</xref></td><td>PSF</td><td>Mathematics, Reading, SpellingCollecting CBM data</td><td>No</td><td>Reference</td><td>None</td></tr><tr><td>Marston et al.</td><td><xref ref-type="bibr" rid="bibr56">1992</xref></td><td>PSF</td><td>ReadingAdministering and interpreting CBM-R</td><td>No</td><td>Non-specific</td><td>Specific</td></tr><tr><td>Stecker et al.</td><td><xref ref-type="bibr" rid="bibr70">2008</xref></td><td>PSF</td><td>ReadingCBM for instructional decision-making</td><td>Yes</td><td>Specific</td><td>Non-specific</td></tr><tr><td>Whinnery & Stecker</td><td><xref ref-type="bibr" rid="bibr79">1992</xref></td><td>PSF</td><td>MathematicsFour uses of CBM to enhance instructional decision-making</td><td>Yes</td><td>Non-specific</td><td>Non-specific</td></tr><tr><td>Yell & Stecker</td><td><xref ref-type="bibr" rid="bibr80">2003</xref></td><td>AEI</td><td>ReadingCBM to develop compliant IEPs</td><td>Yes</td><td>Reference</td><td>Reference</td></tr><tr><td>Hasbrouck et al.</td><td><xref ref-type="bibr" rid="bibr42">1999</xref></td><td>LDRP</td><td>ReadingCase studies from a CBM user</td><td>Yes</td><td>Specific</td><td>Specific</td></tr><tr><td>Groves Scott & Konya Weishaar</td><td><xref ref-type="bibr" rid="bibr39">2003</xref></td><td>ISC</td><td>ReadingStep-by-step use of CBM at secondary level</td><td>No</td><td>Specific</td><td>Specific</td></tr><tr><td>Filderman et al.</td><td><xref ref-type="bibr" rid="bibr18">2019</xref></td><td>ISC</td><td>ReadingDBDM at the secondary level</td><td>Yes</td><td>Non-specific</td><td>Specific</td></tr><tr><td>Dennis et al.</td><td><xref ref-type="bibr" rid="bibr7">2014</xref></td><td>ISC</td><td>MathematicsCBM with error analysis for skills analysis</td><td>Yes</td><td>Reference</td><td>Reference</td></tr><tr><td>Poch et al.</td><td><xref ref-type="bibr" rid="bibr64">2022</xref></td><td>ISC</td><td>WritingSteps of DBI to adjust writing instruction</td><td>Yes</td><td>Non-specific</td><td>Non-specific</td></tr><tr><td>McArthur Capizzi & Barton-Arwood</td><td><xref ref-type="bibr" rid="bibr57">2009</xref></td><td>ISC</td><td>ReadingGraphic organizer worksheet as a guide for implementing CBM</td><td>Yes</td><td>Non-specific</td><td>Non-specific</td></tr><tr><td>Whinnery & Fuchs</td><td><xref ref-type="bibr" rid="bibr78">1992</xref></td><td>LDRP</td><td>MathematicsComputer application to link CBM data to instruction</td><td>Yes</td><td>Non-specific</td><td>Specific</td></tr><tr><td>Burns</td><td><xref ref-type="bibr" rid="bibr73">2002</xref></td><td>ISC</td><td>Mathematics, ReadingCase studies of CBM use in general and special education settings</td><td>No</td><td>Specific</td><td>Specific</td></tr><tr><td>Fuchs et al.</td><td><xref ref-type="bibr" rid="bibr29">2015</xref></td><td>ISC</td><td>Mathematics, Reading, SpellingOverview of CBM and its implementation</td><td>No</td><td>Non-specific</td><td>Specific</td></tr><tr><td>Foegen & Morrison</td><td><xref ref-type="bibr" rid="bibr21">2010</xref></td><td>ISC</td><td>MathematicsAlgebra CBM used in the classroom</td><td>No</td><td>Specific</td><td>Specific</td></tr><tr><td>Dombek & Al Otaiba</td><td><xref ref-type="bibr" rid="bibr12">2015</xref></td><td>ISC</td><td>WritingAdministering and scoring K-2 writing CBM</td><td>No</td><td>Reference</td><td>Reference</td></tr><tr><td>McMaster et al.</td><td><xref ref-type="bibr" rid="bibr58">2011</xref></td><td>TEC</td><td>WritingCBM writing tasks for early identification and intervention</td><td>Yes</td><td>Specific</td><td>Non-specific</td></tr><tr><td>Bundock et al.</td><td><xref ref-type="bibr" rid="bibr2">2018</xref></td><td>TEC</td><td>ReadingReducing variability in ORF CBM data</td><td>Yes</td><td>Reference</td><td>Non-specific</td></tr><tr><td>Goo et al.</td><td><xref ref-type="bibr" rid="bibr38">2012</xref></td><td>TEC</td><td>Mathematics, Reading, Spelling, WritingSelecting web-based CBM system</td><td>Yes</td><td>Reference</td><td>Non-specific</td></tr><tr><td>Hessler & Konrad</td><td><xref ref-type="bibr" rid="bibr43">2008</xref></td><td>TEC</td><td>WritingCBM data for IEP writing and instruction</td><td>Yes</td><td>Specific</td><td>Specific</td></tr><tr><td>Pemberton</td><td><xref ref-type="bibr" rid="bibr63">2003</xref></td><td>TEC</td><td>Mathematics, Reading, WritingUsing CBM to monitor and communicate academic progress</td><td>Yes</td><td>Reference</td><td>Reference</td></tr><tr><td>Garcia</td><td><xref ref-type="bibr" rid="bibr35">2007</xref></td><td>TEC</td><td>ReadingCombining CBM and miscue analysis to inform instruction</td><td>No</td><td>Reference</td><td>None</td></tr><tr><td>Kretlow & Blatz</td><td><xref ref-type="bibr" rid="bibr53">2011</xref></td><td>TEC</td><td>ReadingCBM for monitoring student progress</td><td>Yes</td><td>Non-specific</td><td>Non-specific</td></tr><tr><td>Foegen et al.</td><td><xref ref-type="bibr" rid="bibr22">2016</xref></td><td>TEC</td><td>MathematicsSelecting and using online algebra CBM</td><td>Yes</td><td>Non-specific</td><td>Non-specific</td></tr><tr><td>Filderman & Toste</td><td><xref ref-type="bibr" rid="bibr19">2018</xref></td><td>TEC</td><td>ReadingDecision-making with CBM progress data</td><td>Yes</td><td>Reference</td><td>Specific</td></tr></tbody></table> </ephtml> </p> <p>2 <emph>Note.</emph> AEI = <emph>Assessment for Effective Intervention</emph>; ISC = <emph>Intervention in School and Clinic</emph>; LDRP = <emph>Learning Disabilities Research and Practice</emph>; PSF = <emph>Preventing School Failure</emph>; TEC = <emph>TEACHING Exceptional Children</emph>; CBM = curriculum-based measurement; DBDM = Data-based decision-making; DBI = Data-based instruction; IEP = Individualized Education Programs; ORF = oral reading fluency.</p> <p>Table 3. Distribution of CBM Content.</p> <p>Graph</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th align="left">Source</th><th align="center">General CBM</th><th align="center">Conducting CBM</th><th align="center">CBM DBDM</th><th align="center">CBM Other</th><th align="center">Non-CBM assessment</th><th align="center">Other text</th><th align="center">Total</th></tr></thead><tbody><tr><td colspan="8">Text</td></tr><tr><td> # Articles</td><td>28</td><td>24</td><td>22</td><td>0</td><td>17</td><td>25</td><td>n/a</td></tr><tr><td> # Words</td><td>27,861</td><td>22,687</td><td>7,925</td><td>0</td><td>10,051</td><td>13,910</td><td>83,152</td></tr><tr><td> % Words</td><td>26.09%</td><td>21.25%</td><td>8.09 %</td><td>0%</td><td>9.41%</td><td>13.03%</td><td>77.87%</td></tr><tr><td colspan="8">Vignette</td></tr><tr><td> # Articles</td><td>13</td><td>18</td><td>15</td><td>2</td><td>5</td><td>11</td><td>n/a</td></tr><tr><td> # Words</td><td>4,506</td><td>7,477</td><td>5,571</td><td>748</td><td>878</td><td>4,452</td><td>23,632</td></tr><tr><td> % Words</td><td>4.22 %</td><td>7.00%</td><td>5.22%</td><td>0.70%</td><td>0.82%</td><td>4.17%</td><td>22.13%</td></tr><tr><td>Total</td><td>30.31%</td><td>28.25%</td><td>12.64%</td><td>0.70%</td><td>10.23%</td><td>17.2%</td><td>100%</td></tr></tbody></table> </ephtml> </p> <p>3 <emph>Note.</emph> CBM = curriculum-based measurement; DBDM = Data-based decision-making.</p> <p>Table 4. Distribution of CBM Content Across Four Major CBM Instructional Categories: Actual, Equal, and Recommended Distributions.</p> <p>Graph</p> <p> <ephtml> <table><colgroup><col align="left" /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /><col align="char" char="." /></colgroup><thead><tr><th align="left">Source</th><th align="center">General CBM</th><th align="center">Conducting CBM</th><th align="center">CBM DBDM</th><th align="center">CBM Other</th><th align="center">Total</th></tr></thead><tbody><tr><td colspan="6">Actual Distributions</td></tr><tr><td> # Words</td><td>32,367</td><td>30,164</td><td>13,496</td><td>748</td><td>76,775</td></tr><tr><td> %Words</td><td>42.16%</td><td>39.29%</td><td>17.58%</td><td>0.97%</td><td>100%</td></tr><tr><td colspan="6">Equal Distributions</td></tr><tr><td> # Words</td><td>19,193</td><td>19,193</td><td>19,193</td><td>19,193</td><td>76,775</td></tr><tr><td> %Words</td><td>25%</td><td>25%</td><td>25%</td><td>25%</td><td>100</td></tr><tr><td colspan="6">Experienced Trainers' Recommendations<xref ref-type="table-fn" rid="tfn5">a</xref></td></tr><tr><td> # Words</td><td>~13,435</td><td>~27,832</td><td>~25,911</td><td>~9,597</td><td>76,775</td></tr><tr><td> %Words</td><td>17.5%</td><td>36.25%</td><td>33.75%</td><td>12.50%</td><td>100%</td></tr></tbody></table> </ephtml> </p> <ulist> <item>4 <emph>Note.</emph> CBM = curriculum-based measurement; DBDM = Data-based decision-making.</item> <item>5 Number of words was calculated based on recommendations for distribution (%) of CBM content from experienced trainers, as reported in [<reflink idref="bib17" id="ref64">17</reflink>].</item> </ulist> <p>Based on our final corpus of studies, we also calculated the relative representation of CBM content across the five practitioner-focused journals included in this review. These 29 articles represent approximately 0.35% of all articles published across all issues of these journals.</p> <hd id="AN0179766624-14">Content in CBM Practitioner-Focused Articles</hd> <p>To address research question 1, the proportion of text coded to each of the six CBM content categories was calculated. Table 3 presents the percentage of words devoted to each category, separated according to whether the words appeared in the text of the article or the vignette. The category <emph>General CBM Information</emph> accounted for the greatest proportion of all text (30.31% or 32,367 words). Text coded to this category appeared in the main text of 28 articles and 13 vignettes. This category accounted for 26.09% of the main text (27,861 words), and 4.22% of vignette text (4,506 words) across all articles. The next largest percentage of text was coded to the <emph>Conducting CBM</emph> category (28.25%), followed by <emph>Other Text</emph> (17.2%), <emph>CBM DBDM</emph> (12.64%), <emph>Non-CBM Assessment</emph> (10.23%), and <emph>CBM Other</emph> (0.70%).</p> <p>Next, we replicated the analysis reported by [<reflink idref="bib17" id="ref65">17</reflink>]. We examined the text coded to the four CBM categories originally used by those authors: <emph>General CBM Information</emph>, <emph>Conducting CBM</emph>, <emph>CBM DBDM</emph>, and <emph>CBM Other</emph>. In their analysis of PD materials, Espin and colleagues found that 54.7% of presentation slides and 49.6% of manual/book pages were devoted to conducting CBM; 24.5% of presentation slides and 21.9% of manual/book pages were devoted to general CBM information; 11.8% of presentation slides and 13.8% of manual/book pages were devoted to CBM DBDM; and 9.1% of presentation slides and 14.7% of manuals/books were devoted to CBM other. For the 29 practitioner-focused articles included in the present review, 42.2% of the text was devoted to <emph>General CBM Information</emph> and 39.3% to <emph>Conducting CBM</emph>. A substantially smaller proportion of text was devoted to <emph>CBM DBDM</emph> (17.6%), and a negligible proportion was devoted to <emph>CBM Other</emph> (1%; see Table 4).</p> <hd id="AN0179766624-15">Distribution Across CBM Content Categories</hd> <p>Research question 2 focused on the distribution of text across the four main CBM content categories. Specifically, we examined the proportion of text devoted to the instructional decision-making aspect of CBM (i.e., DBDM) compared with the proportion that would be seen if the four categories were equally represented across these CBM-focused practitioner articles. As shown in Table 4, the observed proportion (17.6%) of information on DBDM was lower than the 25% one would expect if equal attention were to be devoted to each category. [<reflink idref="bib17" id="ref66">17</reflink>] included an additional research question to further compare the observed distribution of professional development materials across the four categories to the distribution recommended by experienced CBM trainers, included in Table 4. While expert recommendations were specific to CBM content included in PD materials, it may reasonably be assumed that they indicate a desirable distribution of CBM content relevant to practitioner articles as well. According to these recommendations, the greatest emphasis should be placed on conducting CBM (36.8% of PD content) followed by CBM DBDM (33.8%), general CBM information (17.5%), and CBM other (12.5%).</p> <hd id="AN0179766624-16">Specificity of DBDM Content</hd> <p>Finally, to address Research Question 3, we examined the specificity with which each article addressed the DBDM aspects of CBM. Unlike the process for exploring Research Questions 1 and 2, which quantified the proportion of text devoted to a particular topic, here we assigned holistic codes to each article. Specificity was coded based on the authors' descriptions of <emph>when</emph> and <emph>how</emph> to make instructional decisions in response to CBM data. The following four codes were used to describe specificity: (<reflink idref="bib1" id="ref67">1</reflink>) <emph>none</emph>, (<reflink idref="bib2" id="ref68">2</reflink>) <emph>reference</emph>, (<reflink idref="bib3" id="ref69">3</reflink>) <emph>nonspecific</emph>, and (<reflink idref="bib4" id="ref70">4</reflink>) <emph>specific</emph>. We assigned specificity codes to each article based on two separate categories: (a) <emph>When</emph> to make an instructional change, and (b) <emph>How</emph> to make an instructional change. For example, a given article could be coded Reference for <emph>when</emph> to make a change and nonspecific for <emph>how</emph> to make a change. Of the articles that focused on DBDM content, 17.2% provided <emph>specific</emph> guidance regarding both when and how to make instructional adjustments, 20.7% provided <emph>non-specific</emph> information regarding both when and how to make instructional adjustments, and 17.2% included <emph>references</emph> to both when and how to make instructional adjustments. Another 10.5% of articles included a combination of references and nonspecific guidance while 27.5% included a combination of non-specific and specific guidance, and 6.7% included a reference to making instructional adjustments but no information regarding when to do so. Collectively, 31.0% of articles included specific guidance around either when or how to make an instructional change, but not both, while 51.8% of articles provided no specific guidance in either category. The degree of specificity present in an article was not associated with CBM content area, journal, or date of publication. Additional details and examples of the type of when and how descriptions included in the articles are provided in the following sections.</p> <hd id="AN0179766624-17">When to Make an Instructional Change</hd> <p>Articles were coded as references to <emph>when</emph> to make an instructional change if they mentioned making a decision but did not provide examples, descriptions, or guidance. They included statements such as: "Progress monitoring after instruction would then indicate if they are progressing at an adequate rate or if they are achieving below the aim. In the latter case, data would provide a guide for further instruction." ([<reflink idref="bib12" id="ref71">12</reflink>], p. 282). Of the 29 articles included in the present review, 17% (<emph>n</emph> = 5) referenced when to make and instructional change.</p> <p>Articles that provided non-specific guidance around <emph>when</emph> to make an instructional change mentioned making a decision in response to student data but did not offer details or descriptions of how practitioners might determine it was time to make a change. They included statements such as:</p> <p>At regular intervals, the teacher applies standard decision-making rules to the graphed data and, when the student's actual rate of progress is not as rapid as the anticipated rate of progress, the teacher implements an intervention likely to enhance student achievement ([<reflink idref="bib80" id="ref72">80</reflink>], p. 81).</p> <p>Of the 29 articles, 38% (<emph>n</emph> = 11) provided nonspecific guidance on when to make a change.</p> <p>Articles that provided specific guidance around <emph>when</emph> to make an instructional change included statements such as:</p> <p>With this method, look at the last three data points collected versus the goal line. If a student is performing below the goal line for all three data points, an instructional change is appropriate. If a student is performing above the goal line for all three data points, a higher goal may be needed. If a student performs above and below the goal line, instruction may stay the same because the student is on target toward one's goal ([<reflink idref="bib19" id="ref73">19</reflink>], p. 137).</p> <p>Of the 29 articles, 35% (<emph>n</emph> = 10) provided specific guidance on when to make a change.</p> <hd id="AN0179766624-18">How to Make an Instructional Change</hd> <p>Articles that simply referenced <emph>how</emph> to make an instructional change mentioned the existence of decision-making but did not provide examples or descriptions of the types of adjustments that might be made. They included statements such as:</p> <p>After the goal line is drawn on the graph, the teacher should enter CBM data on the graph each week in order to monitor and evaluate a student's RTI. Graphing each data point as it is collected allows timely evaluation of RTI and needed instructional changes based on the data ([<reflink idref="bib57" id="ref74">57</reflink>], p. 20).</p> <p>Of the 29 articles included in the present review, 35% (<emph>n</emph> = 10) referenced how to make a change. Articles that provided nonspecific guidance around <emph>how</emph> to make an instructional change mentioned categories of change such as goal, dosage, or scaffolding but did not offer details or descriptions. They included statements such as: "If a student is experiencing difficulty during the acquisition stage, manipulating variables such as the format of instruction or the difficulty level of the reading material may be appropriate" ([<reflink idref="bib33" id="ref75">33</reflink>], p. 40). Of the 29 included articles, 38% (<emph>n</emph> = 11) provided nonspecific guidance on when to make and instructional change.</p> <p>Articles that provided specific guidance around <emph>how</emph> to make an instructional change included statements such as:</p> <p>Instructional changes can take several forms. The first type of change might be made to the environment in order to support the learners' needs, such as changing the student's seating during instruction to facilitate better attention or changing the time of instruction to better match the student's learning preference. The second type of change involves modifications to the instructional design. You might change the type of instruction from small group to one-on-one, make sure the student has plenty of time for guided and independent practice of skills taught, provide reteaching when necessary, review skills, or simplify directions. Teachers might also look into changes that involve supplemental instruction. The student might need additional instruction in learning strategies, decoding skills, vocabulary, use of context clues, or visualization to be successful in the current curriculum. You might also want to do a student interview or "think aloud" during oral reading to determine what techniques the student is using during reading ([<reflink idref="bib39" id="ref76">39</reflink>], p. 158).</p> <p>Of the 29 articles, 27% (<emph>n</emph> = 8) provided nonspecific guidance on when to make a change.</p> <hd id="AN0179766624-19">Discussion</hd> <p>Although CBM can be used for screening or benchmarking, arguably its most important feature is its sensitivity to change over time ([<reflink idref="bib8" id="ref77">8</reflink>]; [<reflink idref="bib11" id="ref78">11</reflink>]). For students with or at-risk of learning disability, CBM data can provide educators with critical information to intensify and individualize academic interventions—that is, to effectively implement DBI. When educators have the knowledge, skills, and awareness to respond appropriately to CBM data, they can minimize wasted instructional time and make changes to better align interventions with student learning needs ([<reflink idref="bib30" id="ref79">30</reflink>]; [<reflink idref="bib49" id="ref80">49</reflink>]; [<reflink idref="bib69" id="ref81">69</reflink>]).</p> <hd id="AN0179766624-20">Does CBM Content Adequately Address DBDM?</hd> <p>The current review was initiated in response to the [<reflink idref="bib17" id="ref82">17</reflink>] recommendation that their study be replicated with other CBM training materials, including articles in practitioner journals, to determine whether similar patterns would be observed. Thus, this study systematically reviewed articles on CBM from 12 practitioner-focused journals to examine the amount of attention devoted to DBDM. Journal articles represent an important source of information on conducting CBM that educators may access when they enter the profession. If they do not receive sufficient training in DBDM in their educator education programs, these practitioner articles may be a critical resource accessed by educators who are invested in their own professional growth and the success of their students. Recent survey data indicate that approximately one-quarter of U.S. educators access academic journals when looking for research to inform their selection of classroom practices and intervention strategies ([<reflink idref="bib13" id="ref83">13</reflink>]; [<reflink idref="bib23" id="ref84">23</reflink>]). Despite the importance of this topic, our comprehensive search of 12 journals resulted in only 29 articles (from 5 journals) focused on CBM content for a practitioner audience. This represents approximately 0.35% of all articles published across all issues of these journals.</p> <p>The current review revealed that the proportion of materials dedicated to DBDM (i.e., the use of CBM for instructional decision-making) accounted for 17.58% of the content in practitioner-focused articles. This is a greater proportion than [<reflink idref="bib17" id="ref85">17</reflink>], who reported that DBDM accounted for 13% of the content in CBM professional development materials. That said, this is still substantially less content than would be expected if equal attention were paid to each of the four CBM categories (25%) or if the recommendations of experienced trainers were followed (33.75%).</p> <p>While, in their review of CBM PD materials, Espin et al. found the greatest proportion of attention was given to conducting CBM (53%) followed by general CBM information (24%), in the case of practitioner journal content, the greatest proportion of text was devoted to general CBM information (42.16%) followed by information on conducting CBM (39.29%). That is, most of the text in these articles focused on providing background and rationale for using CBM or the details of how to administer and collect CBM data. While general information on CBM and information on how to conduct CBM certainly is relevant, it is perhaps not where the most attention is needed. The knowledge and skills required to engage in effective DBDM are much more complex, and it is unclear where educators access training and instruction in this area. Another difference between the two reviews is that the <emph>CBM Other</emph> category made up more than 11% of content in Espin et al.'s review of PD materials, but less than 1% in the current review of practitioner-focused articles. It could be that CBM PD materials are geared toward a broader audience using CBM for a variety of purposes (e.g., school-wide screening, placement in RTI tiers for the delivery of focused or intensive intervention, and grouping for small group instruction) while special education practitioner journals may be more likely to focus specifically on CBM for progress monitoring.</p> <hd id="AN0179766624-21">What Is the Specificity of DBDM-Focused Information?</hd> <p>In addition to quantitatively capturing the relative representation of various CBM topics in practitioner journal articles, a further aim of the present review was to describe the specificity with which DBDM was discussed. The purpose was to communicate not only how much coverage exists in the literature but also how <emph>effectively</emph> the DBDM content might equip educators to engage in instructional decision-making. Although 38% of the articles provided specific information describing how to determine <emph>when</emph> to make an instructional adjustment, less than half of that group (17% of all articles) also described specifically <emph>how</emph> to make those adjustments. At present, DBDM content within CBM practitioner articles is lacking in both the quantity and the specificity that would be required to equip educators to improve their data practices and impact student learning.</p> <p>Research has demonstrated that many educators struggle to interpret CBM graphs and to connect data to instruction. Educators may be skilled in CBM administration procedures overall, though remain unsure of what to do with the data they collect. [<reflink idref="bib28" id="ref86">28</reflink>], 2021) examined the extent to which computers may be utilized for a variety of CBM tasks including scoring, graphing, and data analysis. These authors noted that educators consistently had difficulty connecting assessment data to instructional decisions, so they explored the effectiveness of computer-generated instructional recommendations. Although the recommendations were successful in helping teachers identify what students needed to be taught, they failed to identify student-level instructional adjustments. This complex skill falls to individual educators who need targeted training to gain proficiency in DBDM.</p> <hd id="AN0179766624-22">Limitations</hd> <p>Although the present study reflects a comprehensive review of CBM content in practitioner-focused journals, it is constrained by several limitations. First, by choosing to analyze content from a specific set of journals, it is possible that some articles may have been missed. We attempted to limit this possibility by expanding the selection of included journals based on input from CBM researchers, ultimately considering inclusion from a total of 15 journals and systematically reviewing content in 12 of those journals. However, this may not account for all available content.</p> <p>A second limitation is the focus on articles published in practitioner-focused journals. While these may be the most likely journals to which educators have access, it is also possible that they are relying on other, more easily accessible, resources when seeking information on CBM. Many educators are not members of the professional organizations that provide journal access, and it is reasonable to assume that free resources are more likely to be accessed than those requiring a subscription. These include materials shared on blogs or social media, and resources from sites such as <emph>Teachers Pay Teachers</emph> which include both free and low-cost paid content. Recent work has suggested that close to 70% of educators in the United States have downloaded at least one resource from TPT to use in their classrooms ([<reflink idref="bib68" id="ref87">68</reflink>]).</p> <hd id="AN0179766624-23">Directions for Future Research</hd> <p>An opportunity exists to review syllabi, slides, and textbooks from CBM and assessment courses in educator preparation programs to assess the amount of attention devoted to various CBM topics. Identifying gaps in content at the pre-service level may better inform PD design for those currently in the classroom as well as support efforts to strengthen the preparation of future educators. Further research should also be informed by input from educators to identify the resources they most often consult when seeking information on research-based practices. Content analyses of educator-identified resources may yield greater insights into the most common classroom practices as well as provide researchers with more impactful dissemination options.</p> <p>Authors of future practitioner articles on CBM may consider including specific guidance for educators who are unsure how to link their CBM data to instruction and when to make instructional adjustments. Examples of this type of specific guidance can be found in several articles included in the present review (i.e., [<reflink idref="bib3" id="ref88">3</reflink>]; [<reflink idref="bib21" id="ref89">21</reflink>]; [<reflink idref="bib39" id="ref90">39</reflink>]; [<reflink idref="bib42" id="ref91">42</reflink>]; [<reflink idref="bib43" id="ref92">43</reflink>]). Additionally, future practitioner articles should move beyond how and why to conduct CBM. There is a need to provide guidance around interpreting student data and connecting that data to instructional planning and intensification. The relative dearth of information on DBDM within CBM practitioner articles is not an indication that current published articles are of poor quality; existing articles simply had alternate areas of focus within the topic of CBM. Rather, this gap in published content highlights an opportunity to build upon what has been published to extend the conversation to focus on what educators can do with the student data they collect.</p> <p>As we move forward in this research, there is a need to examine what school leaders know about CBM, progress monitoring, and using data to make individual instructional decisions. This line of inquiry will support a more comprehensive understanding of the reasons educators make instructional decisions that are not grounded in data. Although educators enjoy some degree of autonomy within their classrooms, their ability to select interventions and assessments and to engage in specific data-use practices are constrained by a variety of factors including district policies, school culture, and the knowledge and priorities of school leaders. Without the support of school leadership teams, educators may not be afforded the opportunity to engage in research-based practices such as DBDM. It is worth considering the ways in which the training and development of educational leaders create school contexts that either hinder or promote educators' ability to apply their pedagogical knowledge and skills.</p> <hd id="AN0179766624-24">Conclusion</hd> <p>Knowledge of DBDM is essential for effective DBI implementation and meeting the needs of students with or at-risk of learning disability, especially those who require intensive interventions. Knowing the proportion of attention devoted to DBDM within practitioner articles relative to other CBM topics is of little value on its own. The meaningful contribution of the present study is that it demonstrates what is missing when educators turn to practitioner articles to learn about CBM. Although educators are likely to learn a great deal about what CBM is and how it is administered, they are far less likely to learn about the most important and impactful aspects of CBM, the steps that come after the data are graphed.</p> <p>When a student is not making adequate progress, the data point not to a deficit in the child, but rather to a failure of the intervention as currently delivered to support them in reaching the learning goal. Shifting the focus of collecting CBM data from quantifying and reporting student performance to informing instructional practice is a necessary precursor to providing the most effective intervention. Few practices are supported by an evidence base as robust as the one that has been established for using CBM data to make instructional decisions, but students don't benefit from the evidence until it informs the instructional practices in their classrooms. Additional work is needed to translate CBM research into materials that are accessible and widely available. If effective dissemination strategies are implemented, DBDM has the potential to improve classroom practices and drive student achievement. Until educators are skilled in graph reading, data interpretation, and instructional decision-making, their use of CBM will not adequately support student learning and achievement.</p> <ref id="AN0179766624-25"> <title> References </title> <blist> <bibl id="bib1" idref="ref50" type="bt">1</bibl> <bibtext> Brownell M. T., Sindelar P. T., Kiely M. T., Danielson L. C. (2010). Special education teacher quality and preparation: Exposing foundations, constructing a new model. Exceptional Children, 76(3), 357–377. https://doi.org/10.1177/001440291007600307</bibtext> </blist> <blist> <bibl id="bib2" idref="ref68" type="bt">2</bibl> <bibtext> *Bundock K., O'Keeffe B. V., Stokes K., Kladis K. (2018). Strategies for minimizing variability in progress monitoring of oral reading fluency. TEACHING Exceptional Children, 50(5), 273–281. https://doi.org/10.1177/0040059918764097</bibtext> </blist> <blist> <bibl id="bib3" idref="ref69" type="bt">3</bibl> <bibtext> *Burns M. K. (2002). Comprehensive system of assessment to intervention using curriculum-based assessments. Intervention in School and Clinic, 38(1), 8–13. https://doi.org/10.1177/1053451202038001020</bibtext> </blist> <blist> <bibl id="bib4" idref="ref35" type="bt">4</bibl> <bibtext> *Busch T. W., Espin C. A. (2003). Using curriculum-based measurement to prevent failure and assess learning in the content areas. Assessment for Effective Intervention, 28(3–4), 49–58. https://doi.org/10.1177/073724770302800306</bibtext> </blist> <blist> <bibl id="bib5" idref="ref30" type="bt">5</bibl> <bibtext> Clarke B., Shinn M. R. (2004). A Preliminary Investigation Into the Identification and Development of Early Mathematics Curriculum-Based Measurement. School Psychology Review, 33(2), 234–248.</bibtext> </blist> <blist> <bibl id="bib6" idref="ref34" type="bt">6</bibl> <bibtext> Conoyer S. J., Therrien W. J., White K. K. (2022). Meta-analysis of validity and review of alternate form reliability and slope for curriculum-based measurement in science and social studies. Assessment for Effective Intervention, 47(2), 101–111. https://doi.org/10.1177/1534508420978457</bibtext> </blist> <blist> <bibl id="bib7" type="bt">7</bibl> <bibtext> *Dennis M. S., Calhoon M. B., Olson C. L., Williams C. (2014). Using computation curriculum-based measurement probes for error pattern analysis. Intervention in School and Clinic, 49(5), 281–289. https://doi.org/10.1177/1053451213513957</bibtext> </blist> <blist> <bibl id="bib8" idref="ref18" type="bt">8</bibl> <bibtext> Deno S. L. (1985). Curriculum-based measurement: The emerging alternative. Exceptional Children, 52(3), 219–232. https://doi.org/10.1177/001440298505200303</bibtext> </blist> <blist> <bibl id="bib9" idref="ref20" type="bt">9</bibl> <bibtext> Deno S. L., Fuchs L. S. (1987). Developing curriculum-based measurement systems for data-based special education problem solving. Focus on Exceptional Children, 19(8), 1–16. https://doi.org/10.17161/foec.v19i8.7497</bibtext> </blist> <blist> <bibtext> Deno S. L., Mirkin P. K., Chiang B. (1982). Identifying valid measures of reading. Exceptional Children, 49, 36–45. https://doi.org/10.1177/001440298204900105</bibtext> </blist> <blist> <bibtext> Deno S. L., Mirkin P. K. (1977). Data-based program modification: A manual. Council for Exceptional Children.</bibtext> </blist> <blist> <bibtext> *Dombek J. L., Al Otaiba S. A. (2016). Curriculum-based measurement for beginning writers (K–2). Intervention in School and Clinic, 51(5), 276–283. https://doi.org/10.1177/1053451215606691</bibtext> </blist> <blist> <bibtext> Education Week Research Center. (2017). Data: Where do teachers get their ideas? https://<ulink href="http://www.edweek.org/teaching-learning/data-where-do-teachers-get-their-ideas">www.edweek.org/teaching-learning/data-where-do-teachers-get-their-ideas</ulink></bibtext> </blist> <blist> <bibtext> Endrew, F. v. Douglas County School District, 580 U.S. (2017).</bibtext> </blist> <blist> <bibtext> Espin C. A., Wallace T., Campbell H., Lembke E. S., Long J. D., Ticha R. (2008). Curriculum-based measurement in writing: Predicting the success of high-school students on state standards tests. Exceptional Children, 74(2), 174–193. https://doi.org/10.1177/001440290807400203</bibtext> </blist> <blist> <bibtext> Espin C. A., Saab N., Pat-El R., Boender P. D., van der Veen J. (2018). Curriculum-based measurement progress data: Effects of graph pattern on ease of interpretation. Zeitschrift für Erziehungswissenschaft [Journal of Pedagogical Science], 21(4), 767–792. https://doi.org/10.1007/s11618-018-0836-9</bibtext> </blist> <blist> <bibtext> Espin C. A., van den Bosch R. M., van der Liende M., Rippe R. C., Beutick M., Langa A., Mol S. E. (2021). A systematic review of CBM professional development materials: Are teachers receiving sufficient instruction in data-based decision-making? Journal of Learning Disabilities, 54(4), 256–268. https://doi.org/10.1177/0022219421997103</bibtext> </blist> <blist> <bibtext> *Filderman M. J., Austin C. R., Toste J. R. (2019). Data-based decision making for struggling readers in the secondary grades. Intervention in School and Clinic, 55(1), 3–12. https://doi.org/10.1177/1053451219832991</bibtext> </blist> <blist> <bibtext> *Filderman M. J., Toste J. R. (2018). Decisions, decisions, decisions: Using data to make instructional decisions for struggling readers. TEACHING Exceptional Children, 50(3), 130–140. https://doi.org/10.1177/0040059917740701</bibtext> </blist> <blist> <bibtext> Filderman M. J., Toste J. R., Didion L., Peng P. (2021). Data literacy training for K–12 teachers: A meta-analysis of the effects on teacher outcomes. Remedial and Special Education, 43(5), 328–343. https://doi.org/10.1177/07419325211054208</bibtext> </blist> <blist> <bibtext> *Foegen A., Morrison C. (2010). Putting algebra progress monitoring into practice: Insights from the field. Intervention in School and Clinic, 46(2), 95–103. https://doi.org/10.1177/1053451210375302</bibtext> </blist> <blist> <bibtext> *Foegen A., Stecker P. M., Genareo V. R., Lyons R., Olson J. R., Simpson A., Romig J. E., Jones R. (2016). Using an online tool for learning about and implementing algebra progress monitoring. TEACHING Exceptional Children, 49(2), 106–114. https://doi.org/10.1177/0040059916674327</bibtext> </blist> <blist> <bibtext> Friedman S. (2018, November 27). How educators utilize research. THE Journal. https://thejournal.com/articles/2018/11/27/how-educators-utilize-research.aspx</bibtext> </blist> <blist> <bibtext> Friel S. N., Curcio F. R., Bright G. W. (2001). Making sense of graphs: Critical factors influencing comprehension and instructional implications. Journal for Research in Mathematics Education, 32(2), 124–158. https://doi.org/10.2307/749671</bibtext> </blist> <blist> <bibtext> Fuchs L. S., Deno S. L. (1991). Paradigmatic distinctions between instructionally relevant measurement models. Exceptional Children, 57, 488–501. https://doi.org/10.1177/001440299105700603</bibtext> </blist> <blist> <bibtext> Fuchs L. S., Deno S. L. (1992). Effects of curriculum within curriculum-based measurement. Exceptional Children, 58, 232–243. https://doi.org/10.1177/001440299105800306</bibtext> </blist> <blist> <bibtext> *Fuchs L. S., Fuchs D. (1991). Curriculum-based measurements: Current applications and future directions. Preventing School Failure: Alternative Education for Children and Youth, 35(3), 6–11. https://doi.org/10.1080/1045988X.1991.10871068</bibtext> </blist> <blist> <bibtext> Fuchs L. S., Fuchs D. (2002). Computer applications to curriculum-based measurement. Special Services in the Schools, 17(1–2), 1–14. https://doi.org/10.1300/J008v17n01_01</bibtext> </blist> <blist> <bibtext> *Fuchs L. S., Fuchs D., Hamlett C. L. (2015). Curriculum-based measurement: A standardized, long-term goal approach to monitoring student progress. Intervention in School and Clinic, 50(3), 185–192. https://doi.org/10.1177/105345129002500508</bibtext> </blist> <blist> <bibtext> Fuchs L. S., Fuchs D., Hamlett C. L., Stecker P. M. (2021). Bringing data-based individualization to scale: A call for the next-generation technology of teacher supports. Journal of Learning Disabilities, 54(5), 319–333. https://doi.org/10.1177/0022219420950654</bibtext> </blist> <blist> <bibtext> Fuchs L. S., Fuchs D., Maxwell L. (1988). The validity of informal reading comprehension measures. Remedial and Special Education, 9(2), 20–28. https://doi.org/10.1177/074193258800900206</bibtext> </blist> <blist> <bibtext> *Fuchs L. S., Fuchs D., Zumeta R. O. (2008). A curricular-sampling approach to progress monitoring: Mathematics concepts and applications. Assessment for Effective Intervention, 33(4), 225–233. https://doi.org/10.1177/1534508407313484</bibtext> </blist> <blist> <bibtext> *Gable R. A., Hendrickson J. M., Meeks J. W., Evans S. S., Evans W. H. (1990). Curriculum-based measurement of oral reading: Linking assessment and instruction. Preventing School Failure: Alternative Education for Children and Youth, 35(1), 37–42. https://doi.org/10.1080/1045988X.1990.9944248</bibtext> </blist> <blist> <bibtext> Gansle K. A., VanDerHeyden A. M., Noell G. H., Resetar J. L., Williams K. L. (2006). The technical adequacy of curriculum-based and rating-based measures of written expression for elementary school students. School Psychology Review, 35(3), 435–450.</bibtext> </blist> <blist> <bibtext> *Garcia T. (2007). Facilitating the reading process: A combination approach. TEACHING Exceptional Children, 39(3), 12–17. https://doi.org/10.1177/004005990703900302</bibtext> </blist> <blist> <bibtext> Gesel S. A., LeJeune L. M., Chow J. C., Sinclair A. C., Lemons C. J. (2021). A meta-analysis of the impact of professional development on teachers' knowledge, skill, and self-efficacy in data-based decision-making. Journal of Learning Disabilities, 54(4), 269–283. https://doi.org/10.1177/0022219420970196</bibtext> </blist> <blist> <bibtext> Glazer N. (2011). Challenges with graph interpretation: A review of the literature. Studies in science education, 47(2), 183–210.</bibtext> </blist> <blist> <bibtext> *Goo M., Watt S., Park Y., Hosp J. (2012). A guide to choosing web-based curriculum-based measurements for the classroom. TEACHING Exceptional Children, 45(2), 34–40. https://journals.sagepub.com/doi/pdf/10.1177/004005991204500204</bibtext> </blist> <blist> <bibtext> *Groves Scott V., Konya Weishaar M. (2003). Curriculum-based measurement for reading progress. Intervention in School and Clinic, 38(3), 153–159. https://doi.org/10.1177/10534512030380030401</bibtext> </blist> <blist> <bibtext> Harris P. A., Taylor R., Minor B. L., Elliott V., Fernandez M., O'Neal L., McLeod L., Delacqua G., Delacqua F., Kirby J., Duda S. N., & REDCap Consortium. (2019). The REDCap consortium: Building an international community of software platform partners. Journal of Biomedical Informatics, 95, 1–10. https://doi.org/10.1016/j.jbi.2019.103208</bibtext> </blist> <blist> <bibtext> Harris P. A., Taylor R., Thielke R., Payne J., Gonzalez N., Conde J. G. (2009). Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics, 42(2), 377–381. https://doi.org/10.1016/j.jbi.2008.08.010</bibtext> </blist> <blist> <bibtext> *Hasbrouck J. E., Woldbeck T., Ihnot C., Parker R. I. (1999). One teacher's use of curriculum-based measurement: A changed opinion. Learning Disabilities Research & Practice, 14(2), 118–126. https://doi.org/10.1207/sldrp1402_5</bibtext> </blist> <blist> <bibtext> *Hessler T., Konrad M. (2008). Using curriculum-based measurement to drive IEPs and instruction in written expression. TEACHING Exceptional Children, 41(2), 28–37. https://doi.org/10.1177/004005990804100204</bibtext> </blist> <blist> <bibtext> Hintze J. M., Silberglitt B. (2005). A longitudinal examination of the diagnostic accuracy and predictive validity of R-CBM and high-stakes testing. School Psychology Review, 34, 372–386. https://doi.org/10.1080/02796015.2005.12086292</bibtext> </blist> <blist> <bibtext> *Hosp M. K., Hosp J. L. (2003). Curriculum-based measurement for reading, spelling, and math: How to do it and why. Preventing School Failure: Alternative Education for Children and Youth, 48(3), 10–17. https://doi.org/10.1080/1045988X.2003.10871074</bibtext> </blist> <blist> <bibtext> Hosp M. K., Hosp J. L., Howell K. W. (2016). The ABCs of CBM: A practical guide to curriculum-based measurement. Guilford Publications.</bibtext> </blist> <blist> <bibtext> Individuals with Disabilities Education Act, 20 U.S.C. § 1400. (2004).</bibtext> </blist> <blist> <bibtext> Jung P. G., McMaster K. L., Kunkel A. K., Shin J., Stecker P. M. (2018). Effects of data-based individualization for students with intensive learning needs: A meta-analysis. Learning Disabilities Research & Practice, 33(3), 144–155. https://doi.org/10.1111/ldrp.12172</bibtext> </blist> <blist> <bibtext> Kearns D. M., Feinberg N. J., Anderson L. J. (2021). Implementation of data-based decision-making: Linking research from the special series to practice. Journal of Learning Disabilities, 54(5), 365–372. https://doi.org/10.1177/00222194211032403</bibtext> </blist> <blist> <bibtext> Keller-Margulis M. A., Shapiro E. S., Hintze J. M. (2008). Long-term diagnostic accuracy of curriculum-based measures in reading and mathematics. School Psychology Review, 37(3), 374–390.</bibtext> </blist> <blist> <bibtext> Kennedy M. J., Wagner D., Stegall J., Lembke E., Miciak J., Alves K. D., Brown T., Driver M. K., Hirsch S. E. (2016). Using content acquisition podcasts to improve teacher candidate knowledge of curriculum-based measurement. Exceptional Children, 82(3), 303–320. https://doi.org/10.1177/0014402915615885</bibtext> </blist> <blist> <bibtext> Kim D., Choi S. (2021). The effects of data-based instruction (DBI) for students with learning difficulties in Korea: A single-subject meta-analysis. PLOS ONE, 16(12), 1–23. https://doi.org/10.1371/journal.pone.0261120</bibtext> </blist> <blist> <bibtext> *Kretlow A. G., Blatz S. L. (2011). The ABCs of evidence-based practice for teachers. TEACHING Exceptional Children, 43(5), 8–19. https://doi.org/10.1177/004005991104300501</bibtext> </blist> <blist> <bibtext> Mandinach E. B., Gummer E. S. (2013). A systemic view of implementing data literacy in educator preparation. Educational Researcher, 42(1), 30–37. https://doi.org/10.3102/0013189X12459803</bibtext> </blist> <blist> <bibtext> Marston D. B. (1989). A curriculum-based measurement approach to assessing academic performance: What it is and why do it. In Shinn M. R. (Ed.), Curriculum-based measurement: Assessing special children (pp. 18–78). The Guilford Press.</bibtext> </blist> <blist> <bibtext> *Marston D., Diment K., Allen D., Allen L. (1992). Monitoring pupil progress in reading. Preventing School Failure: Alternative Education for Children and Youth, 36(2), 21–25. https://doi.org/10.1080/1045988X.1992.9944265</bibtext> </blist> <blist> <bibtext> *McArthur Capizzi A., Barton-Arwood S. M. (2009). Using a curriculum-based measurement graphic organizer to facilitate collaboration in reading. Intervention in School and Clinic, 45(1), 14–23. https://doi.org/10.1177/1053451209338394</bibtext> </blist> <blist> <bibtext> *McMaster K. L., Du X., Parker D. C., Pinto V. (2011). Using curriculum-based measurement for struggling beginning writers. TEACHING Exceptional Children, 44(2), 26–34. https://doi.org/10.1177/004005991104400203</bibtext> </blist> <blist> <bibtext> McMaster K. L., Lembke E. S., Shin J., Poch A. L., Smith R. A., Jung P. G., Allen A. A., Wagner K. (2020). Supporting teachers' use of data-based instruction to improve students' early writing skills. Journal of Educational Psychology, 112(1), 1–21. https://doi.org/10.1037/edu0000358</bibtext> </blist> <blist> <bibtext> National Academies of Sciences, Engineering, and Medicine. (2022). The future of education research at IES: Advancing an equity-oriented science. https://doi.org/10.17226/26428</bibtext> </blist> <blist> <bibtext> National Center on Intensive Intervention at American Institutes for Research. (2013). Data-based individualization: A framework for intensive intervention. ERIC Clearinghouse.</bibtext> </blist> <blist> <bibtext> Oslund E. L., Elleman A. M., Wallace K. (2021). Factors related to data-based decision-making: Examining experience, professional development, and the mediating effect of confidence on teacher graph literacy. Journal of Learning Disabilities, 54(4), 243–255. https://doi.org/10.1177/0022219420972187</bibtext> </blist> <blist> <bibtext> *Pemberton J. B. (2003). Communicating academic progress as an integral part of assessment. TEACHING Exceptional Children, 35(4), 16–20. https://doi.org/10.1177/004005990303500403</bibtext> </blist> <blist> <bibtext> *Poch A. L., Allen A. A., Jung P. G., Lembke E. S., McMaster K. L. (2022). Using data-based instruction to support struggling elementary writers. Intervention in School and Clinic, 57(3), 147–155. https://doi.org/10.1177/10534512211014835</bibtext> </blist> <blist> <bibtext> Powell S. R., Bos S. E., King S. G., Ketterlin-Geller L., Lembke E. S. (2022). Using the data-based individualization framework in math intervention. TEACHING Exceptional Children, 20(10), 1–11. https://doi.org/10.1177/00400599221111114</bibtext> </blist> <blist> <bibtext> Reschly A. L., Busch T. W., Betts J., Deno S. L., Long J. D. (2009). Curriculum-based measurement oral reading as an indicator of reading achievement: A meta-analysis of the correlational evidence. Journal of School Psychology, 47(6), 427–469. https://doi.org/10.1016/j.jsp.2009.07.001</bibtext> </blist> <blist> <bibtext> Romig J. E., Therrien W. J., Lloyd J. W. (2017). Meta-analysis of criterion validity for curriculum-based measurementin written language. The Journal of Special Education, 51(2), 72–82. https://doi.org/10.1177/0022466916670637</bibtext> </blist> <blist> <bibtext> Shelton C. C., Koehler M. J., Greenhalgh S. P., Carpenter J. P. (2022). Lifting the veil on TeachersPayTeachers.com: An investigation of educational marketplace offerings and downloads. Learning, Media and Technology, 47(2), 268–287. https://doi.org/10.1080/17439884.2021.1961148</bibtext> </blist> <blist> <bibtext> Stecker P. M., Fuchs L. S., Fuchs D. (2005). Using curriculum-based measurement to improve student achievement: Review of research. Psychology in the Schools, 42(8), 795–819.</bibtext> </blist> <blist> <bibtext> *Stecker P. M., Lembke E. S., Foegen A. (2008). Using progress-monitoring data to improve instructional decision making. Preventing School Failure: Alternative Education for Children and Youth, 52, 48–58. https://doi.org/10.3200/PSFL.52.2.48-58</bibtext> </blist> <blist> <bibtext> van den Bosch R. M., Espin C. A., Chung S., Saab N. (2017). Data-based decision-making: Teachers' comprehension of curriculum-based measurement progress-monitoring graphs. Learning Disabilities Research & Practice, 32(1), 46–60. https://doi.org/10.1111/ldrp.12122</bibtext> </blist> <blist> <bibtext> van den Bosch R. M., Espin C. A., Pat-El R. J., Saab N. (2019). Improving teachers' comprehension of curriculum-based measurement progress-monitoring graphs. Journal of Learning Disabilities, 52(5), 413–427. https://doi.org/10.1111/ldrp.12122</bibtext> </blist> <blist> <bibtext> VanDerHeyden A. M., Burns M. K. (2005). Using curriculum-based assessment and curriculum-based measurement to guide elementary mathematics instruction: Effect on individual and group accountability scores. Assessment for Effective Intervention, 30(3), 15–31. https://doi.org/10.1177/073724770503000302</bibtext> </blist> <blist> <bibtext> Van Norman E. R., Christ T. J. (2016). How accurate are interpretations of curriculum-based measurement progress monitoring data? Visual analysis versus decision rules. Journal of School Psychology, 58, 41–55. https://doi.org/10.1016/j.jsp.2016.07.003</bibtext> </blist> <blist> <bibtext> Wachen J., Harrison C., Cohen-Vogel L. (2018). Data use as instructional reform: Exploring educators' reports of classroom practice. Leadership and Policy in Schools, 17(2), 296–325.</bibtext> </blist> <blist> <bibtext> Wayman M. M., Wallace T., Wiley H. I., Tichá R., Espin C. A. (2007). Literature synthesis on curriculum-based measurement in reading. The Journal of Special Education, 41(2),85–120.</bibtext> </blist> <blist> <bibtext> Wayman J. C., Jimerson J. B. (2014). Teacher needs for data-related professional learning. Studies in Educational Evaluation, 42, 25–34. https://doi.org/10.1016/j.stueduc.2013.11.001</bibtext> </blist> <blist> <bibtext> *Whinnery K. W., Fuchs L. S. (1992). Implementing effective teaching strategies with learning disabled students through curriculum-based measurement. Learning Disabilities Research & Practice, 7(1), 25–32.</bibtext> </blist> <blist> <bibtext> *Whinnery K. W., Stecker P. M. (1992). Individual progress monitoring to enhance instructional programs in mathematics. Preventing School Failure: Alternative Education for Children and Youth, 36(2), 26–29. https://doi.org/10.1080/1045988X.1992.9944266</bibtext> </blist> <blist> <bibtext> *Yell M. L., Stecker P. M. (2003). Developing legally correct and educationally meaningful IEPs using curriculum-based measurement. Assessment for Effective Intervention, 28(3–4), 73–88. https://doi.org/10.1177/073724770302800308</bibtext> </blist> </ref> <ref id="AN0179766624-26"> <title> Footnotes </title> <blist> <bibtext> The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.</bibtext> </blist> <blist> <bibtext> This research was supported in part by the U.S. Department of Education, Institute of Education Sciences, through grant R324A190126 to The University of Texas at Austin and in part by the U.S. Department of Education, Office of Special Education Programs, through funding received from a Personnel Development to Improve Services and Results for Children with Disabilities Grant. Nothing in this paper necessarily reflects the positions or policies of the agency and no endorsement by it should be inferred.</bibtext> </blist> <blist> <bibtext> Erica C. Fry</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibtext>https://orcid.org/0009-0008-9393-1408 Jessica R. Toste</bibtext> </blist> <blist> <bibtext>Graph</bibtext> </blist> <blist> <bibtext>https://orcid.org/0000-0002-6327-0054 Christine A. Espin</bibtext> </blist> <blist> <bibtext>Graph https://orcid.org/0000-0003-0407-5897</bibtext> </blist> </ref> <aug> <p>By Erica C. Fry; Jessica R. Toste; Beth R. Feuer and Christine A. Espin</p> <p>Reported by Author; Author; Author; Author</p> </aug> <nolink nlid="nl1" bibid="bib47" firstref="ref1"></nolink> <nolink nlid="nl2" bibid="bib14" firstref="ref2"></nolink> <nolink nlid="nl3" bibid="bib30" firstref="ref3"></nolink> <nolink nlid="nl4" bibid="bib61" firstref="ref4"></nolink> <nolink nlid="nl5" bibid="bib11" firstref="ref5"></nolink> <nolink nlid="nl6" bibid="bib48" firstref="ref6"></nolink> <nolink nlid="nl7" bibid="bib52" firstref="ref7"></nolink> <nolink nlid="nl8" bibid="bib16" firstref="ref8"></nolink> <nolink nlid="nl9" bibid="bib62" firstref="ref9"></nolink> <nolink nlid="nl10" bibid="bib69" firstref="ref10"></nolink> <nolink nlid="nl11" bibid="bib71" firstref="ref11"></nolink> <nolink nlid="nl12" bibid="bib20" firstref="ref12"></nolink> <nolink nlid="nl13" bibid="bib36" firstref="ref13"></nolink> <nolink nlid="nl14" bibid="bib77" firstref="ref14"></nolink> <nolink nlid="nl15" bibid="bib59" firstref="ref15"></nolink> <nolink nlid="nl16" bibid="bib72" firstref="ref17"></nolink> <nolink nlid="nl17" bibid="bib10" firstref="ref19"></nolink> <nolink nlid="nl18" bibid="bib25" firstref="ref21"></nolink> <nolink nlid="nl19" bibid="bib26" firstref="ref22"></nolink> <nolink nlid="nl20" bibid="bib50" firstref="ref23"></nolink> <nolink nlid="nl21" bibid="bib55" firstref="ref24"></nolink> <nolink nlid="nl22" bibid="bib66" firstref="ref25"></nolink> <nolink nlid="nl23" bibid="bib15" firstref="ref26"></nolink> <nolink nlid="nl24" bibid="bib31" firstref="ref27"></nolink> <nolink nlid="nl25" bibid="bib76" firstref="ref28"></nolink> <nolink nlid="nl26" bibid="bib44" firstref="ref29"></nolink> <nolink nlid="nl27" bibid="bib67" firstref="ref33"></nolink> <nolink nlid="nl28" bibid="bib34" firstref="ref36"></nolink> <nolink nlid="nl29" bibid="bib73" firstref="ref37"></nolink> <nolink nlid="nl30" bibid="bib28" firstref="ref38"></nolink> <nolink nlid="nl31" bibid="bib46" firstref="ref39"></nolink> <nolink nlid="nl32" bibid="bib74" firstref="ref41"></nolink> <nolink nlid="nl33" bibid="bib65" firstref="ref43"></nolink> <nolink nlid="nl34" bibid="bib75" firstref="ref44"></nolink> <nolink nlid="nl35" bibid="bib54" firstref="ref46"></nolink> <nolink nlid="nl36" bibid="bib24" firstref="ref48"></nolink> <nolink nlid="nl37" bibid="bib37" firstref="ref49"></nolink> <nolink nlid="nl38" bibid="bib51" firstref="ref51"></nolink> <nolink nlid="nl39" bibid="bib17" firstref="ref52"></nolink> <nolink nlid="nl40" bibid="bib13" firstref="ref53"></nolink> <nolink nlid="nl41" bibid="bib23" firstref="ref54"></nolink> <nolink nlid="nl42" bibid="bib60" firstref="ref57"></nolink> <nolink nlid="nl43" bibid="bib41" firstref="ref60"></nolink> <nolink nlid="nl44" bibid="bib40" firstref="ref61"></nolink> <nolink nlid="nl45" bibid="bib12" firstref="ref71"></nolink> <nolink nlid="nl46" bibid="bib80" firstref="ref72"></nolink> <nolink nlid="nl47" bibid="bib19" firstref="ref73"></nolink> <nolink nlid="nl48" bibid="bib57" firstref="ref74"></nolink> <nolink nlid="nl49" bibid="bib33" firstref="ref75"></nolink> <nolink nlid="nl50" bibid="bib39" firstref="ref76"></nolink> <nolink nlid="nl51" bibid="bib49" firstref="ref80"></nolink> <nolink nlid="nl52" bibid="bib68" firstref="ref87"></nolink> <nolink nlid="nl53" bibid="bib21" firstref="ref89"></nolink> <nolink nlid="nl54" bibid="bib42" firstref="ref91"></nolink> <nolink nlid="nl55" bibid="bib43" firstref="ref92"></nolink>
Header DbId: eric
DbLabel: ERIC
An: EJ1440408
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A Systematic Review of CBM Content in Practitioner-Focused Journals: Do We Talk about Instructional Decision-Making?
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Erica+C%2E+Fry%22">Erica C. Fry</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0008-9393-1408">0009-0008-9393-1408</externalLink>)<br /><searchLink fieldCode="AR" term="%22Jessica+R%2E+Toste%22">Jessica R. Toste</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-6327-0054">0000-0002-6327-0054</externalLink>)<br /><searchLink fieldCode="AR" term="%22Beth+R%2E+Feuer%22">Beth R. Feuer</searchLink><br /><searchLink fieldCode="AR" term="%22Christine+A%2E+Espin%22">Christine A. Espin</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-0407-5897">0000-0003-0407-5897</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Learning+Disabilities%22"><i>Journal of Learning Disabilities</i></searchLink>. 2024 57(5):275-290.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications and Hammill Institute on Disabilities. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 16
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Institute of Education Sciences (ED)<br />Office of Special Education Programs (OSEP) (ED/OSERS)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: R324A190126
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Information Analyses
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Evidence+Based+Practice%22">Evidence Based Practice</searchLink><br /><searchLink fieldCode="DE" term="%22Decision+Making%22">Decision Making</searchLink><br /><searchLink fieldCode="DE" term="%22Curriculum+Based+Assessment%22">Curriculum Based Assessment</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Disabilities%22">Learning Disabilities</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Collection%22">Data Collection</searchLink><br /><searchLink fieldCode="DE" term="%22Content+Analysis%22">Content Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Use%22">Data Use</searchLink><br /><searchLink fieldCode="DE" term="%22Individualized+Education+Programs%22">Individualized Education Programs</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1177/00222194231215031
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0022-2194<br />1538-4780
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Data-based decision-making (DBDM) using curriculum-based measurement (CBM) data has demonstrated effectiveness in improving academic achievement for students with or at risk for learning disability. Despite substantial evidence supporting DBDM, its use is not common practice for many educators, even those who regularly collect CBM data. One explanation for its lack of widespread use is that educators may not receive adequate training in the DBDM aspects of CBM. Espin et al. examined the extent to which DBDM is represented in CBM professional development (PD) materials and found that the topic was significantly underrepresented (12% to 14% of CBM PD material content) compared with other CBM topics. The purpose of this study was to conduct a conceptual replication of the Espin et al. systematic review through an analysis of CBM content in practitioner journal articles. The present review includes 29 practitioner articles coded to the four CBM categories used in the Espin et al. study: (a) general CBM information, (b) conducting CBM, (c) data-based decision-making, and (d) other. Results revealed a pattern similar to the one found by Espin et al. with approximately 18% of the content of practitioner articles on CBM devoted to the topic of decision-making. These findings strengthen the recommendation from Espin et al. for increased attention to DBDM in CBM training materials.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: CodeSource
  Label: IES Funded
  Group: SrcInfo
  Data: Yes
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2024
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1440408
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1440408
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1177/00222194231215031
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 16
        StartPage: 275
    Subjects:
      – SubjectFull: Evidence Based Practice
        Type: general
      – SubjectFull: Decision Making
        Type: general
      – SubjectFull: Curriculum Based Assessment
        Type: general
      – SubjectFull: Learning Disabilities
        Type: general
      – SubjectFull: Data Collection
        Type: general
      – SubjectFull: Content Analysis
        Type: general
      – SubjectFull: Data Use
        Type: general
      – SubjectFull: Individualized Education Programs
        Type: general
    Titles:
      – TitleFull: A Systematic Review of CBM Content in Practitioner-Focused Journals: Do We Talk about Instructional Decision-Making?
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Erica C. Fry
      – PersonEntity:
          Name:
            NameFull: Jessica R. Toste
      – PersonEntity:
          Name:
            NameFull: Beth R. Feuer
      – PersonEntity:
          Name:
            NameFull: Christine A. Espin
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 09
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 0022-2194
            – Type: issn-electronic
              Value: 1538-4780
          Numbering:
            – Type: volume
              Value: 57
            – Type: issue
              Value: 5
          Titles:
            – TitleFull: Journal of Learning Disabilities
              Type: main
ResultId 1