Keep It Simple: Picking the Right Data Science Method to Improve Workforce Training Programs. OPRE Report 2023-058

Saved in:
Bibliographic Details
Title: Keep It Simple: Picking the Right Data Science Method to Improve Workforce Training Programs. OPRE Report 2023-058
Language: English
Authors: Preel-Dumas, Camille, Hendra, Richard, Denison, Dakota, MDRC, ICF International
Source: MDRC. 2023.
Availability: MDRC. 16 East 34th Street 19th Floor, New York, NY 10016-4326. Tel: 212-532-3200; Fax: 212-684-0832; e-mail: publications@mdrc.org; Web site: http://www.mdrc.org
Peer Reviewed: N
Page Count: 4
Publication Date: 2023
Sponsoring Agency: Administration for Children and Families (DHHS), Office of Planning, Research and Evaluation (OPRE)
Contract Number: GS00F010CA/140D0421F0706
90PE0038
Document Type: Reports - Evaluative
Descriptors: Labor Force Development, Programs, Prediction, Success, Data Science, Research Methodology, Educational Improvement, Management Information Systems, Program Effectiveness, Dropout Prevention, Artificial Intelligence, Employment Level, Prior Learning, Educational Attainment, Barriers, At Risk Persons, Data Use
Abstract: This brief explores data science methods that workforce programs can use to predict participant success. With access to vast amounts of data on their programs, workforce training providers can leverage their management information systems (MIS) to understand and improve their programs' outcomes. By predicting which participants are at greater risk of dropping out of their program and why, providers can segment their caseloads so that participants receive services better tailored to their needs. Within the data science field, machine learning (ML) has gained popularity for its ability to extract hidden patterns without being explicitly guided by a data analyst. While these data science methods hold promise, are the added costs and complexity worth it? The authors explore the tradeoffs by answering the following questions: (1) What factors are important in predicting a participant's outcome in a program?; (2) Are participant outcomes predictable using simple methods, like creating basic risk indicators in Management Information Systems (MIS)? For example, how well does an indicator for prior education predict participant outcomes?; and (3) What is the added value and cost of incorporating regression and more complex machine learning methods?
Abstractor: ERIC
Entry Date: 2023
Accession Number: ED628518
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED628518
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED628518
AccessLevel: 3
PubType: Report
PubTypeId: report
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Keep It Simple: Picking the Right Data Science Method to Improve Workforce Training Programs. OPRE Report 2023-058
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Preel-Dumas%2C+Camille%22">Preel-Dumas, Camille</searchLink><br /><searchLink fieldCode="AR" term="%22Hendra%2C+Richard%22">Hendra, Richard</searchLink><br /><searchLink fieldCode="AR" term="%22Denison%2C+Dakota%22">Denison, Dakota</searchLink><br /><searchLink fieldCode="AR" term="%22MDRC%22">MDRC</searchLink><br /><searchLink fieldCode="AR" term="%22ICF+International%22">ICF International</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22MDRC%22"><i>MDRC</i></searchLink>. 2023.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: MDRC. 16 East 34th Street 19th Floor, New York, NY 10016-4326. Tel: 212-532-3200; Fax: 212-684-0832; e-mail: publications@mdrc.org; Web site: http://www.mdrc.org
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: N
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 4
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2023
– Name: SourceSuprt
  Label: Sponsoring Agency
  Group: SrcSuprt
  Data: Administration for Children and Families (DHHS), Office of Planning, Research and Evaluation (OPRE)
– Name: NumberContract
  Label: Contract Number
  Group: NumCntrct
  Data: GS00F010CA/140D0421F0706<br />90PE0038
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Reports - Evaluative
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Labor+Force+Development%22">Labor Force Development</searchLink><br /><searchLink fieldCode="DE" term="%22Programs%22">Programs</searchLink><br /><searchLink fieldCode="DE" term="%22Prediction%22">Prediction</searchLink><br /><searchLink fieldCode="DE" term="%22Success%22">Success</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Science%22">Data Science</searchLink><br /><searchLink fieldCode="DE" term="%22Research+Methodology%22">Research Methodology</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Improvement%22">Educational Improvement</searchLink><br /><searchLink fieldCode="DE" term="%22Management+Information+Systems%22">Management Information Systems</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Effectiveness%22">Program Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Dropout+Prevention%22">Dropout Prevention</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Employment+Level%22">Employment Level</searchLink><br /><searchLink fieldCode="DE" term="%22Prior+Learning%22">Prior Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Attainment%22">Educational Attainment</searchLink><br /><searchLink fieldCode="DE" term="%22Barriers%22">Barriers</searchLink><br /><searchLink fieldCode="DE" term="%22At+Risk+Persons%22">At Risk Persons</searchLink><br /><searchLink fieldCode="DE" term="%22Data+Use%22">Data Use</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This brief explores data science methods that workforce programs can use to predict participant success. With access to vast amounts of data on their programs, workforce training providers can leverage their management information systems (MIS) to understand and improve their programs' outcomes. By predicting which participants are at greater risk of dropping out of their program and why, providers can segment their caseloads so that participants receive services better tailored to their needs. Within the data science field, machine learning (ML) has gained popularity for its ability to extract hidden patterns without being explicitly guided by a data analyst. While these data science methods hold promise, are the added costs and complexity worth it? The authors explore the tradeoffs by answering the following questions: (1) What factors are important in predicting a participant's outcome in a program?; (2) Are participant outcomes predictable using simple methods, like creating basic risk indicators in Management Information Systems (MIS)? For example, how well does an indicator for prior education predict participant outcomes?; and (3) What is the added value and cost of incorporating regression and more complex machine learning methods?
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: ERIC
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2023
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED628518
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED628518
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 4
    Subjects:
      – SubjectFull: Labor Force Development
        Type: general
      – SubjectFull: Programs
        Type: general
      – SubjectFull: Prediction
        Type: general
      – SubjectFull: Success
        Type: general
      – SubjectFull: Data Science
        Type: general
      – SubjectFull: Research Methodology
        Type: general
      – SubjectFull: Educational Improvement
        Type: general
      – SubjectFull: Management Information Systems
        Type: general
      – SubjectFull: Program Effectiveness
        Type: general
      – SubjectFull: Dropout Prevention
        Type: general
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Employment Level
        Type: general
      – SubjectFull: Prior Learning
        Type: general
      – SubjectFull: Educational Attainment
        Type: general
      – SubjectFull: Barriers
        Type: general
      – SubjectFull: At Risk Persons
        Type: general
      – SubjectFull: Data Use
        Type: general
    Titles:
      – TitleFull: Keep It Simple: Picking the Right Data Science Method to Improve Workforce Training Programs. OPRE Report 2023-058
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: MDRC
      – PersonEntity:
          Name:
            NameFull: ICF International
      – PersonEntity:
          Name:
            NameFull: Preel-Dumas, Camille
      – PersonEntity:
          Name:
            NameFull: Hendra, Richard
      – PersonEntity:
          Name:
            NameFull: Denison, Dakota
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 02
              Type: published
              Y: 2023
          Titles:
            – TitleFull: MDRC
              Type: main
ResultId 1