Investigating the Promise of Automated Writing Evaluation for Supporting Formative Writing Assessment at Scale

Saved in:
Bibliographic Details
Title: Investigating the Promise of Automated Writing Evaluation for Supporting Formative Writing Assessment at Scale
Language: English
Authors: Wilson, Joshua (ORCID 0000-0002-7192-3510), Myers, Matthew C., Potter, Andrew
Source: Assessment in Education: Principles, Policy & Practice. 2022 29(2):183-199.
Availability: Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Peer Reviewed: Y
Page Count: 17
Publication Date: 2022
Document Type: Journal Articles
Reports - Research
Education Level: Elementary Education
Early Childhood Education
Grade 3
Primary Education
Grade 4
Intermediate Grades
Grade 5
Middle Schools
Descriptors: Writing Evaluation, Formative Evaluation, Automation, Elementary School Teachers, Teacher Attitudes, Elementary School Students, Grade 3, Grade 4, Grade 5, Program Implementation, Writing Achievement
DOI: 10.1080/0969594X.2022.2025762
ISSN: 0969-594X
1465-329X
Abstract: We investigated the promise of a novel approach to formative writing assessment at scale that involved an automated writing evaluation (AWE) system called MI Write. Specifically, we investigated elementary teachers' perceptions and implementation of MI Write and changes in students' writing performance in three genres from Fall to Spring associated with this implementation. Teachers in Grades 3-5 (n = 14) reported that MI Write was usable and acceptable, useful, and desirable; however, teachers tended to implement MI Write in a limited manner. Multilevel repeated measures analyses indicated that students in Grades 3-5 (n = 570) tended not to increase their performance from Fall to Spring except for third graders in all genres and fourth graders' narrative writing. Findings illustrate the importance of educators utilising scalable formative assessments to evaluate and adjust core instruction.
Abstractor: As Provided
Entry Date: 2022
Accession Number: EJ1356469
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1356469
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Investigating the Promise of Automated Writing Evaluation for Supporting Formative Writing Assessment at Scale
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Wilson%2C+Joshua%22">Wilson, Joshua</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-7192-3510">0000-0002-7192-3510</externalLink>)<br /><searchLink fieldCode="AR" term="%22Myers%2C+Matthew+C%2E%22">Myers, Matthew C.</searchLink><br /><searchLink fieldCode="AR" term="%22Potter%2C+Andrew%22">Potter, Andrew</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Assessment+in+Education%3A+Principles%2C+Policy+%26+Practice%22"><i>Assessment in Education: Principles, Policy & Practice</i></searchLink>. 2022 29(2):183-199.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 17
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Elementary+Education%22">Elementary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Early+Childhood+Education%22">Early Childhood Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+3%22">Grade 3</searchLink><br /><searchLink fieldCode="EL" term="%22Primary+Education%22">Primary Education</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+4%22">Grade 4</searchLink><br /><searchLink fieldCode="EL" term="%22Intermediate+Grades%22">Intermediate Grades</searchLink><br /><searchLink fieldCode="EL" term="%22Grade+5%22">Grade 5</searchLink><br /><searchLink fieldCode="EL" term="%22Middle+Schools%22">Middle Schools</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Writing+Evaluation%22">Writing Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Formative+Evaluation%22">Formative Evaluation</searchLink><br /><searchLink fieldCode="DE" term="%22Automation%22">Automation</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+School+Teachers%22">Elementary School Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Teacher+Attitudes%22">Teacher Attitudes</searchLink><br /><searchLink fieldCode="DE" term="%22Elementary+School+Students%22">Elementary School Students</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+3%22">Grade 3</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+4%22">Grade 4</searchLink><br /><searchLink fieldCode="DE" term="%22Grade+5%22">Grade 5</searchLink><br /><searchLink fieldCode="DE" term="%22Program+Implementation%22">Program Implementation</searchLink><br /><searchLink fieldCode="DE" term="%22Writing+Achievement%22">Writing Achievement</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1080/0969594X.2022.2025762
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 0969-594X<br />1465-329X
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: We investigated the promise of a novel approach to formative writing assessment at scale that involved an automated writing evaluation (AWE) system called MI Write. Specifically, we investigated elementary teachers' perceptions and implementation of MI Write and changes in students' writing performance in three genres from Fall to Spring associated with this implementation. Teachers in Grades 3-5 (n = 14) reported that MI Write was usable and acceptable, useful, and desirable; however, teachers tended to implement MI Write in a limited manner. Multilevel repeated measures analyses indicated that students in Grades 3-5 (n = 570) tended not to increase their performance from Fall to Spring except for third graders in all genres and fourth graders' narrative writing. Findings illustrate the importance of educators utilising scalable formative assessments to evaluate and adjust core instruction.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1356469
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1356469
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/0969594X.2022.2025762
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 17
        StartPage: 183
    Subjects:
      – SubjectFull: Writing Evaluation
        Type: general
      – SubjectFull: Formative Evaluation
        Type: general
      – SubjectFull: Automation
        Type: general
      – SubjectFull: Elementary School Teachers
        Type: general
      – SubjectFull: Teacher Attitudes
        Type: general
      – SubjectFull: Elementary School Students
        Type: general
      – SubjectFull: Grade 3
        Type: general
      – SubjectFull: Grade 4
        Type: general
      – SubjectFull: Grade 5
        Type: general
      – SubjectFull: Program Implementation
        Type: general
      – SubjectFull: Writing Achievement
        Type: general
    Titles:
      – TitleFull: Investigating the Promise of Automated Writing Evaluation for Supporting Formative Writing Assessment at Scale
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Wilson, Joshua
      – PersonEntity:
          Name:
            NameFull: Myers, Matthew C.
      – PersonEntity:
          Name:
            NameFull: Potter, Andrew
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2022
          Identifiers:
            – Type: issn-print
              Value: 0969-594X
            – Type: issn-electronic
              Value: 1465-329X
          Numbering:
            – Type: volume
              Value: 29
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: Assessment in Education: Principles, Policy & Practice
              Type: main
ResultId 1