Re-Thinking Invigilation Implementation: A Mixed Method Approach to Student Perceptions and System Usability for Digital Assessment Adoption

Saved in:
Bibliographic Details
Title: Re-Thinking Invigilation Implementation: A Mixed Method Approach to Student Perceptions and System Usability for Digital Assessment Adoption
Language: English
Authors: Liandi van den Berg (ORCID 0000-0002-2325-6194)
Source: International Journal for Educational Integrity. 2025 21.
Availability: BioMed Central, Ltd. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://www.springer.com/gp/biomedical-sciences
Peer Reviewed: Y
Page Count: 28
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Foreign Countries, College Faculty, College Students, Computer Assisted Testing, Examiners, Handheld Devices, Testing, Testing Problems, Student Attitudes, Technology Integration, Ethics, Electronic Learning, Cheating
Geographic Terms: South Africa
DOI: 10.1007/s40979-025-00183-w
Abstract: Due to the coronavirus disease 2019 (COVID-2019) and the sudden shift to online learning, higher education institutions adopted various approaches to reduce cheating in online assessments, mainly involving online live proctoring (OLP). The international assessment integrity regulation trend also applied to a university in South Africa, where accounting lecturers implemented using a mobile invigilation application (app) during online off-campus assessments. This study explored student perceptions and the system usability of an invigilation app during digital assessments to develop a framework for enhanced technology adoption. This study used a mixed-method, convergence parallel approach from the functionalist paradigm. This included the qualitative exploration of students' open-ended online feedback and responses on the System Usability Scale (SUS) after using an invigilator app on their mobile phones during an assessment. The Technology Acceptance Model (TAM) (Davis, MIS Quarterly 13:319-340, 1989) was used as a theoretical foundation for the study. Universal elements of students' perceived invigilation experiences identified by Marano et al. (Higher Education Quarterly e12506, 2023) were added to the TAM constructs to create a conceptual framework for the exploration. Students' online written responses were analysed through the constant comparative method (Boeije, Quantity and Quality 36:391-409, 2002) using ATLAS.ti™ software. Findings were presented as data networks based on the codes created and discussed according to the conceptual framework. The SUS results converged with the qualitative findings to create a novel conceptual model for enhanced invigilation technology implementation. The converged conceptual framework serves as a blueprint for addressing the successful implementation of an invigilation system with average usability by intentionally preparing students and leveraging learnability to address individual and technological concerns, perceived usefulness, perceived ease of use and attitude for increased technology adoption.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1461747
Database: ERIC
FullText Text:
  Availability: 0
Header DbId: eric
DbLabel: ERIC
An: EJ1461747
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Re-Thinking Invigilation Implementation: A Mixed Method Approach to Student Perceptions and System Usability for Digital Assessment Adoption
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Liandi+van+den+Berg%22">Liandi van den Berg</searchLink> (ORCID <externalLink term="http://orcid.org/0000-0002-2325-6194">0000-0002-2325-6194</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Journal+for+Educational+Integrity%22"><i>International Journal for Educational Integrity</i></searchLink>. 2025 21.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: BioMed Central, Ltd. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://www.springer.com/gp/biomedical-sciences
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 28
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22College+Faculty%22">College Faculty</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Examiners%22">Examiners</searchLink><br /><searchLink fieldCode="DE" term="%22Handheld+Devices%22">Handheld Devices</searchLink><br /><searchLink fieldCode="DE" term="%22Testing%22">Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Testing+Problems%22">Testing Problems</searchLink><br /><searchLink fieldCode="DE" term="%22Student+Attitudes%22">Student Attitudes</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Integration%22">Technology Integration</searchLink><br /><searchLink fieldCode="DE" term="%22Ethics%22">Ethics</searchLink><br /><searchLink fieldCode="DE" term="%22Electronic+Learning%22">Electronic Learning</searchLink><br /><searchLink fieldCode="DE" term="%22Cheating%22">Cheating</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22South+Africa%22">South Africa</searchLink>
– Name: DOI
  Label: DOI
  Group: ID
  Data: 10.1007/s40979-025-00183-w
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: Due to the coronavirus disease 2019 (COVID-2019) and the sudden shift to online learning, higher education institutions adopted various approaches to reduce cheating in online assessments, mainly involving online live proctoring (OLP). The international assessment integrity regulation trend also applied to a university in South Africa, where accounting lecturers implemented using a mobile invigilation application (app) during online off-campus assessments. This study explored student perceptions and the system usability of an invigilation app during digital assessments to develop a framework for enhanced technology adoption. This study used a mixed-method, convergence parallel approach from the functionalist paradigm. This included the qualitative exploration of students' open-ended online feedback and responses on the System Usability Scale (SUS) after using an invigilator app on their mobile phones during an assessment. The Technology Acceptance Model (TAM) (Davis, MIS Quarterly 13:319-340, 1989) was used as a theoretical foundation for the study. Universal elements of students' perceived invigilation experiences identified by Marano et al. (Higher Education Quarterly e12506, 2023) were added to the TAM constructs to create a conceptual framework for the exploration. Students' online written responses were analysed through the constant comparative method (Boeije, Quantity and Quality 36:391-409, 2002) using ATLAS.ti™ software. Findings were presented as data networks based on the codes created and discussed according to the conceptual framework. The SUS results converged with the qualitative findings to create a novel conceptual model for enhanced invigilation technology implementation. The converged conceptual framework serves as a blueprint for addressing the successful implementation of an invigilation system with average usability by intentionally preparing students and leveraging learnability to address individual and technological concerns, perceived usefulness, perceived ease of use and attitude for increased technology adoption.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1461747
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1461747
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1007/s40979-025-00183-w
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 28
    Subjects:
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: College Faculty
        Type: general
      – SubjectFull: College Students
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Examiners
        Type: general
      – SubjectFull: Handheld Devices
        Type: general
      – SubjectFull: Testing
        Type: general
      – SubjectFull: Testing Problems
        Type: general
      – SubjectFull: Student Attitudes
        Type: general
      – SubjectFull: Technology Integration
        Type: general
      – SubjectFull: Ethics
        Type: general
      – SubjectFull: Electronic Learning
        Type: general
      – SubjectFull: Cheating
        Type: general
      – SubjectFull: South Africa
        Type: general
    Titles:
      – TitleFull: Re-Thinking Invigilation Implementation: A Mixed Method Approach to Student Perceptions and System Usability for Digital Assessment Adoption
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Liandi van den Berg
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 12
              Type: published
              Y: 2025
          Numbering:
            – Type: volume
              Value: 21
          Titles:
            – TitleFull: International Journal for Educational Integrity
              Type: main
ResultId 1