Measures Matter: A Meta-Analysis of the Effects of Educational Apps on Preschool to Grade 3 Children's Literacy and Math Skills

Saved in:
Bibliographic Details
Title: Measures Matter: A Meta-Analysis of the Effects of Educational Apps on Preschool to Grade 3 Children's Literacy and Math Skills
Language: English
Authors: Kim, James (ORCID 0000-0002-6415-5496), Gilbert, Joshua, Yu, Qun, Gale, Charles
Source: AERA Open. Jan-Dec 2021 7(1).
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
Peer Reviewed: Y
Page Count: 19
Publication Date: 2021
Document Type: Journal Articles
Information Analyses
Reports - Research
Education Level: Elementary Education
Early Childhood Education
Grade 1
Primary Education
Grade 2
Grade 3
Preschool Education
Kindergarten
Descriptors: Meta Analysis, Measures (Individuals), Educational Technology, Handheld Devices, Preschool Children, Elementary School Students, Grade 1, Grade 2, Grade 3, Preschool Education, Literacy, Mathematics Skills, Effect Size, Academic Achievement, Instructional Effectiveness, Kindergarten
ISSN: 2332-8584
Abstract: Thousands of educational apps are available to students, teachers, and parents, yet research on their effectiveness is limited. This meta-analysis synthesized findings from 36 intervention studies and 285 effect sizes evaluating the effectiveness of educational apps for preschool to Grade 3 children and the moderating role of methodological, participant, and intervention characteristics. Using random effects meta-regression with robust variance estimation, we summarized the overall impact of educational apps and examined potential moderator effects. First, results from rigorous experimental and quasi-experimental studies yielded a mean weighted effect size of +0.31 standard deviations on overall achievement and comparable effects in both math and literacy. Second, the positive overall effect masks substantial variability in app effectiveness, as meta-regression analyses revealed three significant moderators of treatment effects. Treatment effects were larger for studies involving preschool rather than K-3 students, for studies using researcher-developed rather than standardized outcomes, and for studies measuring constrained rather than unconstrained skills.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1323865
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1323865
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1323865
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Measures Matter: A Meta-Analysis of the Effects of Educational Apps on Preschool to Grade 3 Children's Literacy and Math Skills
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Kim%2C+James%22">Kim, James</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-6415-5496">0000-0002-6415-5496</externalLink>)<br /><searchLink fieldCode="AR" term="%22Gilbert%2C+Joshua%22">Gilbert, Joshua</searchLink><br /><searchLink fieldCode="AR" term="%22Yu%2C+Qun%22">Yu, Qun</searchLink><br /><searchLink fieldCode="AR" term="%22Gale%2C+Charles%22">Gale, Charles</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22AERA+Open%22"><i>AERA Open</i></searchLink>. Jan-Dec 2021 7(1).
– Name: Avail
  Label: Availability
  Group: Avail
  Data: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: http://sagepub.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 19
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2021
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Information Analyses<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+1%22">Grade 1</searchLink><br /><searchLink fieldCode="EL" term="%22Primary+Education%22">Primary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+2%22">Grade 2</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+3%22">Grade 3</searchLink><br /><searchLink fieldCode="EL" term="%22Preschool+Education%22">Preschool Education</searchLink><br /><searchLink fieldCode="EL" term="%22Kindergarten%22">Kindergarten</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Meta+Analysis%22">Meta Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Measures+%28Individuals%29%22">Measures (Individuals)</searchLink><br /><searchLink fieldCode="DE" term="%22Educational+Technology%22">Educational Technology</searchLink><br /><searchLink fieldCode="DE" term="%22Handheld+Devices%22">Handheld Devices</searchLink><br /><searchLink fieldCode="DE" term="%22Preschool+Children%22">Preschool Children</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+School+Students%22">Elementary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+1%22">Grade 1</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+2%22">Grade 2</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+3%22">Grade 3</searchLink><br /><searchLink fieldCode="DE" term="%22Preschool+Education%22">Preschool Education</searchLink><br /><searchLink fieldCode="DE" term="%22Literacy%22">Literacy</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics+Skills%22">Mathematics Skills</searchLink><br /><searchLink fieldCode="DE" term="%22Effect+Size%22">Effect Size</searchLink><br /><searchLink fieldCode="DE" term="%22Academic+Achievement%22">Academic Achievement</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+Effectiveness%22">Instructional Effectiveness</searchLink><br /><searchLink fieldCode="DE" term="%22Kindergarten%22">Kindergarten</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2332-8584
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Thousands of educational apps are available to students, teachers, and parents, yet research on their effectiveness is limited. This meta-analysis synthesized findings from 36 intervention studies and 285 effect sizes evaluating the effectiveness of educational apps for preschool to Grade 3 children and the moderating role of methodological, participant, and intervention characteristics. Using random effects meta-regression with robust variance estimation, we summarized the overall impact of educational apps and examined potential moderator effects. First, results from rigorous experimental and quasi-experimental studies yielded a mean weighted effect size of +0.31 standard deviations on overall achievement and comparable effects in both math and literacy. Second, the positive overall effect masks substantial variability in app effectiveness, as meta-regression analyses revealed three significant moderators of treatment effects. Treatment effects were larger for studies involving preschool rather than K-3 students, for studies using researcher-developed rather than standardized outcomes, and for studies measuring constrained rather than unconstrained skills.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1323865
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1323865
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 19
    Subjects:
      – SubjectFull: Meta Analysis
        Type: general
      – SubjectFull: Measures (Individuals)
        Type: general
      – SubjectFull: Educational Technology
        Type: general
      – SubjectFull: Handheld Devices
        Type: general
      – SubjectFull: Preschool Children
        Type: general
      – SubjectFull: Elementary School Students
        Type: general
      – SubjectFull: Grade 1
        Type: general
      – SubjectFull: Grade 2
        Type: general
      – SubjectFull: Grade 3
        Type: general
      – SubjectFull: Preschool Education
        Type: general
      – SubjectFull: Literacy
        Type: general
      – SubjectFull: Mathematics Skills
        Type: general
      – SubjectFull: Effect Size
        Type: general
      – SubjectFull: Academic Achievement
        Type: general
      – SubjectFull: Instructional Effectiveness
        Type: general
      – SubjectFull: Kindergarten
        Type: general
    Titles:
      – TitleFull: Measures Matter: A Meta-Analysis of the Effects of Educational Apps on Preschool to Grade 3 Children's Literacy and Math Skills
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Kim, James
      – PersonEntity:
          Name:
            NameFull: Gilbert, Joshua
      – PersonEntity:
          Name:
            NameFull: Yu, Qun
      – PersonEntity:
          Name:
            NameFull: Gale, Charles
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2021
          Identifiers:
            – Type: issn-electronic
              Value: 2332-8584
          Numbering:
            – Type: volume
              Value: 7
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: AERA Open
              Type: main
ResultId 1