View in EDS

Detecting SMART Model Cognitive Operations in Mathematical Problem-Solving Process

Saved in:
Bibliographic Details
Title: Detecting SMART Model Cognitive Operations in Mathematical Problem-Solving Process
Language: English
Authors: Zhang, Jiayi, Andres, Juliana Ma. Alexandra L., Hutt, Stephen, Baker, Ryan S., Ocumpaugh, Jaclyn, Mills, Caitlin, Brooks, Jamiella, Sethuraman, Sheela, Young, Tyron
Source: International Educational Data Mining Society. 2022.
Availability: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
Peer Reviewed: Y
Page Count: 11
Publication Date: 2022
Document Type: Speeches/Meeting Papers
Reports - Research
Education Level: Junior High Schools
Middle Schools
Secondary Education
Descriptors: Mathematics Instruction, Teaching Methods, Problem Solving, Metacognition, Learning Strategies, Guidelines, Protocol Analysis, Models, Learning Analytics, Integrated Learning Systems, Scaffolding (Teaching Technique), Peer Relationship, Measurement, Middle School Students
Abstract: Self-regulated learning (SRL) is a critical component of mathematics problem solving. Students skilled in SRL are more likely to effectively set goals, search for information, and direct their attention and cognitive process so that they align their efforts with their objectives. An influential framework for SRL, the SMART model, proposes that five cognitive operations (i.e., searching, monitoring, assembling, rehearsing, and translating) play a key role in SRL. However, these categories encompass a wide range of behaviors, making measurement challenging -- often involving observing individual students and recording their think-aloud activities or asking students to complete labor-intensive tagging activities as they work. In the current study, we develop machine-learned indicators of SMART operations, in order to achieve better scalability than other measurement approaches. We analyzed student's textual responses and interaction data collected from a mathematical learning platform where students are asked to thoroughly explain their solutions and are scaffolded in communicating their problem-solving process to their peers and teachers. We built detectors of four indicators of SMART operations (namely, assembling and translating operations). Our detectors are found to be reliable and generalizable, with AUC ROCs ranging from 0.76-0.89. When applied to the full test set, the detectors are robust against algorithmic bias, performing well across different student populations. [For the full proceedings, see ED623995.]
Abstractor: As Provided
Entry Date: 2022
Accession Number: ED624069
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED624069
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: ED624069
AccessLevel: 3
PubType: Conference
PubTypeId: conference
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Detecting SMART Model Cognitive Operations in Mathematical Problem-Solving Process
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Zhang%2C+Jiayi%22">Zhang, Jiayi</searchLink><br /><searchLink fieldCode="AR" term="%22Andres%2C+Juliana+Ma%2E+Alexandra+L%2E%22">Andres, Juliana Ma. Alexandra L.</searchLink><br /><searchLink fieldCode="AR" term="%22Hutt%2C+Stephen%22">Hutt, Stephen</searchLink><br /><searchLink fieldCode="AR" term="%22Baker%2C+Ryan+S%2E%22">Baker, Ryan S.</searchLink><br /><searchLink fieldCode="AR" term="%22Ocumpaugh%2C+Jaclyn%22">Ocumpaugh, Jaclyn</searchLink><br /><searchLink fieldCode="AR" term="%22Mills%2C+Caitlin%22">Mills, Caitlin</searchLink><br /><searchLink fieldCode="AR" term="%22Brooks%2C+Jamiella%22">Brooks, Jamiella</searchLink><br /><searchLink fieldCode="AR" term="%22Sethuraman%2C+Sheela%22">Sethuraman, Sheela</searchLink><br /><searchLink fieldCode="AR" term="%22Young%2C+Tyron%22">Young, Tyron</searchLink>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Educational+Data+Mining+Society%22"><i>International Educational Data Mining Society</i></searchLink>. 2022.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Educational Data Mining Society. e-mail: admin@educationaldatamining.org; Web site: https://educationaldatamining.org/conferences/
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 11
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2022
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Speeches/Meeting Papers<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Junior+High+Schools%22">Junior High Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Middle+Schools%22">Middle Schools</searchLink><br /><searchLink fieldCode="EL" term="%22Secondary+Education%22">Secondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Mathematics+Instruction%22">Mathematics Instruction</searchLink><br /><searchLink fieldCode="DE" term="%22Teaching+Methods%22">Teaching Methods</searchLink><br /><searchLink fieldCode="DE" term="%22Problem+Solving%22">Problem Solving</searchLink><br /><searchLink fieldCode="DE" term="%22Metacognition%22">Metacognition</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Strategies%22">Learning Strategies</searchLink><br /><searchLink fieldCode="DE" term="%22Guidelines%22">Guidelines</searchLink><br /><searchLink fieldCode="DE" term="%22Protocol+Analysis%22">Protocol Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Models%22">Models</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Analytics%22">Learning Analytics</searchLink><br /><searchLink fieldCode="DE" term="%22Integrated+Learning+Systems%22">Integrated Learning Systems</searchLink><br /><searchLink fieldCode="DE" term="%22Scaffolding+%28Teaching+Technique%29%22">Scaffolding (Teaching Technique)</searchLink><br /><searchLink fieldCode="DE" term="%22Peer+Relationship%22">Peer Relationship</searchLink><br /><searchLink fieldCode="DE" term="%22Measurement%22">Measurement</searchLink><br /><searchLink fieldCode="DE" term="%22Middle+School+Students%22">Middle School Students</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Self-regulated learning (SRL) is a critical component of mathematics problem solving. Students skilled in SRL are more likely to effectively set goals, search for information, and direct their attention and cognitive process so that they align their efforts with their objectives. An influential framework for SRL, the SMART model, proposes that five cognitive operations (i.e., searching, monitoring, assembling, rehearsing, and translating) play a key role in SRL. However, these categories encompass a wide range of behaviors, making measurement challenging -- often involving observing individual students and recording their think-aloud activities or asking students to complete labor-intensive tagging activities as they work. In the current study, we develop machine-learned indicators of SMART operations, in order to achieve better scalability than other measurement approaches. We analyzed student's textual responses and interaction data collected from a mathematical learning platform where students are asked to thoroughly explain their solutions and are scaffolded in communicating their problem-solving process to their peers and teachers. We built detectors of four indicators of SMART operations (namely, assembling and translating operations). Our detectors are found to be reliable and generalizable, with AUC ROCs ranging from 0.76-0.89. When applied to the full test set, the detectors are robust against algorithmic bias, performing well across different student populations. [For the full proceedings, see ED623995.]
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2022
– Name: AN
  Label: Accession Number
  Group: ID
  Data: ED624069
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=ED624069
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 11
    Subjects:
      – SubjectFull: Mathematics Instruction
        Type: general
      – SubjectFull: Teaching Methods
        Type: general
      – SubjectFull: Problem Solving
        Type: general
      – SubjectFull: Metacognition
        Type: general
      – SubjectFull: Learning Strategies
        Type: general
      – SubjectFull: Guidelines
        Type: general
      – SubjectFull: Protocol Analysis
        Type: general
      – SubjectFull: Models
        Type: general
      – SubjectFull: Learning Analytics
        Type: general
      – SubjectFull: Integrated Learning Systems
        Type: general
      – SubjectFull: Scaffolding (Teaching Technique)
        Type: general
      – SubjectFull: Peer Relationship
        Type: general
      – SubjectFull: Measurement
        Type: general
      – SubjectFull: Middle School Students
        Type: general
    Titles:
      – TitleFull: Detecting SMART Model Cognitive Operations in Mathematical Problem-Solving Process
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Zhang, Jiayi
      – PersonEntity:
          Name:
            NameFull: Andres, Juliana Ma. Alexandra L.
      – PersonEntity:
          Name:
            NameFull: Hutt, Stephen
      – PersonEntity:
          Name:
            NameFull: Baker, Ryan S.
      – PersonEntity:
          Name:
            NameFull: Ocumpaugh, Jaclyn
      – PersonEntity:
          Name:
            NameFull: Mills, Caitlin
      – PersonEntity:
          Name:
            NameFull: Brooks, Jamiella
      – PersonEntity:
          Name:
            NameFull: Sethuraman, Sheela
      – PersonEntity:
          Name:
            NameFull: Young, Tyron
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2022
          Titles:
            – TitleFull: International Educational Data Mining Society
              Type: main
ResultId 1