An Online Student Testlet-Generation System: Design Principles and Evidence Supporting Its Learning Potential and Usefulness

Saved in:
Bibliographic Details
Title: An Online Student Testlet-Generation System: Design Principles and Evidence Supporting Its Learning Potential and Usefulness
Language: English
Authors: Fu-Yun Yu (ORCID 0000-0001-8583-6402)
Source: Interactive Learning Environments. 2024 32(10):7542-7558.
Availability: Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Peer Reviewed: Y
Page Count: 17
Publication Date: 2024
Document Type: Journal Articles
Reports - Research
Descriptors: Computer Assisted Testing, Test Format, Test Construction, Test Items, Scaffolding (Teaching Technique), Affordances, Student Participation, Learning Management Systems, Web 2.0 Technologies, Prompting, Usability, Editing
DOI: 10.1080/10494820.2024.2327040
ISSN: 1049-4820
1744-5191
Abstract: Currently, 50 + learning systems supporting student question-generation (SQG) activities have been developed. While generating questions of different types is supported in many of these systems, systems allowing students to generate questions around a scenario (i.e. student testlet-generation, STG) are not yet available. Noting the increasing prevalence of testlets in contemporary testing and their learning potential through the lens of anchored instruction, this study aimed to develop a versatile, scaffolded online STG learning system. The results from three evaluative studies supported the learning potential of the world's first-ever STG system and the usefulness of its distinctive functionalities. Specifically, significantly more participants regarded the online STG task as promoting better learning, with the most prominent feature of STG -- the scenario highlighted for the pronounced learning benefits. Additionally, given that the distinct affordances associated with STG based on given text and graphics were well-noted, the practicality of the 'multi-presentation' design concept for scenarios was verified. Furthermore, data from the participants' perceived usefulness of editable and self-created scenarios validated the importance of the 'editability' and 'self-expression' design concepts. Finally, with the distinctive functionalities incorporated in the developed STG system having their respective supporters, the concept of building a diversified STG learning space is upheld.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1455859
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1455859
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: An Online Student Testlet-Generation System: Design Principles and Evidence Supporting Its Learning Potential and Usefulness
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Fu-Yun+Yu%22">Fu-Yun Yu</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0001-8583-6402">0000-0001-8583-6402</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Interactive+Learning+Environments%22"><i>Interactive Learning Environments</i></searchLink>. 2024 32(10):7542-7558.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 17
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2024
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Format%22">Test Format</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Scaffolding+%28Teaching+Technique%29%22">Scaffolding (Teaching Technique)</searchLink><br /><searchLink fieldCode="DE" term="%22Affordances%22">Affordances</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Participation%22">Student Participation</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Management+Systems%22">Learning Management Systems</searchLink><br /><searchLink fieldCode="DE" term="%22Web+2%2E0+Technologies%22">Web 2.0 Technologies</searchLink><br /><searchLink fieldCode="DE" term="%22Prompting%22">Prompting</searchLink><br /><searchLink fieldCode="DE" term="%22Usability%22">Usability</searchLink><br /><searchLink fieldCode="DE" term="%22Editing%22">Editing</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1080/10494820.2024.2327040
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 1049-4820<br />1744-5191
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Currently, 50 + learning systems supporting student question-generation (SQG) activities have been developed. While generating questions of different types is supported in many of these systems, systems allowing students to generate questions around a scenario (i.e. student testlet-generation, STG) are not yet available. Noting the increasing prevalence of testlets in contemporary testing and their learning potential through the lens of anchored instruction, this study aimed to develop a versatile, scaffolded online STG learning system. The results from three evaluative studies supported the learning potential of the world's first-ever STG system and the usefulness of its distinctive functionalities. Specifically, significantly more participants regarded the online STG task as promoting better learning, with the most prominent feature of STG -- the scenario highlighted for the pronounced learning benefits. Additionally, given that the distinct affordances associated with STG based on given text and graphics were well-noted, the practicality of the 'multi-presentation' design concept for scenarios was verified. Furthermore, data from the participants' perceived usefulness of editable and self-created scenarios validated the importance of the 'editability' and 'self-expression' design concepts. Finally, with the distinctive functionalities incorporated in the developed STG system having their respective supporters, the concept of building a diversified STG learning space is upheld.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1455859
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1455859
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1080/10494820.2024.2327040
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 17
        StartPage: 7542
    Subjects:
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Test Format
        Type: general
      – SubjectFull: Test Construction
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Scaffolding (Teaching Technique)
        Type: general
      – SubjectFull: Affordances
        Type: general
      – SubjectFull: Student Participation
        Type: general
      – SubjectFull: Learning Management Systems
        Type: general
      – SubjectFull: Web 2.0 Technologies
        Type: general
      – SubjectFull: Prompting
        Type: general
      – SubjectFull: Usability
        Type: general
      – SubjectFull: Editing
        Type: general
    Titles:
      – TitleFull: An Online Student Testlet-Generation System: Design Principles and Evidence Supporting Its Learning Potential and Usefulness
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Fu-Yun Yu
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2024
          Identifiers:
            – Type: issn-print
              Value: 1049-4820
            – Type: issn-electronic
              Value: 1744-5191
          Numbering:
            – Type: volume
              Value: 32
            – Type: issue
              Value: 10
          Titles:
            – TitleFull: Interactive Learning Environments
              Type: main
ResultId 1