View in EDS

Evaluating the Effectiveness of a Computerized Achievement Test Using Learn Smart for Psychometric Assessment under Item Response Theory

Saved in:
Bibliographic Details
Title: Evaluating the Effectiveness of a Computerized Achievement Test Using Learn Smart for Psychometric Assessment under Item Response Theory
Language: English
Authors: Mimi Ismail (ORCID 0009-0006-8631-2559), Ahmed Al - Badri (ORCID 0009-0006-4765-1259), Said Al - Senaidi (ORCID 0009-0005-5306-5291)
Source: Journal of Education and e-Learning Research. 2025 12(1):115-123.
Availability: Asian Online Journal Publishing Group. 244 Fifth Avenue Suite D42, New York, NY 10001. Fax: 212-591-6094; e-mail: info@asianonlinejournals.com; Web site: http://www.asianonlinejournals.com
Peer Reviewed: Y
Page Count: 9
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Achievement Tests, Computer Assisted Testing, Psychometrics, Item Response Theory, Error Patterns, Test Format, Universities, College Students, Learning Management Systems, Artificial Intelligence, Computer Software, Difficulty Level, Vocabulary, Test Items, Item Analysis, Foreign Countries
Geographic Terms: Oman
ISSN: 2518-0169
2410-9991
Abstract: This study aimed to reveal the differences in individuals' abilities, their standard errors, and the psychometric properties of the test according to the two methods of applying the test (electronic and paper). The descriptive approach was used to achieve the study's objectives. The study sample consisted of 74 male and female students at the University of Technology and Applied Sciences in Rustaq. An electronic test was built on the Learn Smart platform supported by artificial intelligence in psychological measurement. The results showed no statistically significant differences in the individuals' average ability estimates and their standard errors between the electronic and paper-based tests. Besides, the vocabulary difficulty estimates in the electronic test ranged between -2.562 and 2.007 and the vocabulary difficulty estimates in the paper-based test ranged between -3.483 and 2.194. All of them are within the acceptable range. The chi-square values for the electronic test items are not statistically significant except for items (8 and 10). On the other hand, all chi-square values for the items on the paper test are not statistically significant except the item numbers (3, 6, 8, 10 and 12) which are statistically significant at the 0.05 and 0.01 levels.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1470922
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1470922
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1470922
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: Evaluating the Effectiveness of a Computerized Achievement Test Using Learn Smart for Psychometric Assessment under Item Response Theory
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Mimi+Ismail%22">Mimi Ismail</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0006-8631-2559">0009-0006-8631-2559</externalLink>)<br /><searchLink fieldCode="AR" term="%22Ahmed+Al+-+Badri%22">Ahmed Al - Badri</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0006-4765-1259">0009-0006-4765-1259</externalLink>)<br /><searchLink fieldCode="AR" term="%22Said+Al+-+Senaidi%22">Said Al - Senaidi</searchLink> (ORCID <externalLink term="https://orcid.org/0009-0005-5306-5291">0009-0005-5306-5291</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22Journal+of+Education+and+e-Learning+Research%22"><i>Journal of Education and e-Learning Research</i></searchLink>. 2025 12(1):115-123.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: Asian Online Journal Publishing Group. 244 Fifth Avenue Suite D42, New York, NY 10001. Fax: 212-591-6094; e-mail: info@asianonlinejournals.com; Web site: http://www.asianonlinejournals.com
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 9
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Achievement+Tests%22">Achievement Tests</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Psychometrics%22">Psychometrics</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Response+Theory%22">Item Response Theory</searchLink><br /><searchLink fieldCode="DE" term="%22Error+Patterns%22">Error Patterns</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Format%22">Test Format</searchLink><br /><searchLink fieldCode="DE" term="%22Universities%22">Universities</searchLink><br /><searchLink fieldCode="DE" term="%22College+Students%22">College Students</searchLink><br /><searchLink fieldCode="DE" term="%22Learning+Management+Systems%22">Learning Management Systems</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+Intelligence%22">Artificial Intelligence</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Software%22">Computer Software</searchLink><br /><searchLink fieldCode="DE" term="%22Difficulty+Level%22">Difficulty Level</searchLink><br /><searchLink fieldCode="DE" term="%22Vocabulary%22">Vocabulary</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Items%22">Test Items</searchLink><br /><searchLink fieldCode="DE" term="%22Item+Analysis%22">Item Analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Oman%22">Oman</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2518-0169<br />2410-9991
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study aimed to reveal the differences in individuals' abilities, their standard errors, and the psychometric properties of the test according to the two methods of applying the test (electronic and paper). The descriptive approach was used to achieve the study's objectives. The study sample consisted of 74 male and female students at the University of Technology and Applied Sciences in Rustaq. An electronic test was built on the Learn Smart platform supported by artificial intelligence in psychological measurement. The results showed no statistically significant differences in the individuals' average ability estimates and their standard errors between the electronic and paper-based tests. Besides, the vocabulary difficulty estimates in the electronic test ranged between -2.562 and 2.007 and the vocabulary difficulty estimates in the paper-based test ranged between -3.483 and 2.194. All of them are within the acceptable range. The chi-square values for the electronic test items are not statistically significant except for items (8 and 10). On the other hand, all chi-square values for the items on the paper test are not statistically significant except the item numbers (3, 6, 8, 10 and 12) which are statistically significant at the 0.05 and 0.01 levels.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1470922
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1470922
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 9
        StartPage: 115
    Subjects:
      – SubjectFull: Achievement Tests
        Type: general
      – SubjectFull: Computer Assisted Testing
        Type: general
      – SubjectFull: Psychometrics
        Type: general
      – SubjectFull: Item Response Theory
        Type: general
      – SubjectFull: Error Patterns
        Type: general
      – SubjectFull: Test Format
        Type: general
      – SubjectFull: Universities
        Type: general
      – SubjectFull: College Students
        Type: general
      – SubjectFull: Learning Management Systems
        Type: general
      – SubjectFull: Artificial Intelligence
        Type: general
      – SubjectFull: Computer Software
        Type: general
      – SubjectFull: Difficulty Level
        Type: general
      – SubjectFull: Vocabulary
        Type: general
      – SubjectFull: Test Items
        Type: general
      – SubjectFull: Item Analysis
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Oman
        Type: general
    Titles:
      – TitleFull: Evaluating the Effectiveness of a Computerized Achievement Test Using Learn Smart for Psychometric Assessment under Item Response Theory
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Mimi Ismail
      – PersonEntity:
          Name:
            NameFull: Ahmed Al - Badri
      – PersonEntity:
          Name:
            NameFull: Said Al - Senaidi
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-print
              Value: 2518-0169
            – Type: issn-electronic
              Value: 2410-9991
          Numbering:
            – Type: volume
              Value: 12
            – Type: issue
              Value: 1
          Titles:
            – TitleFull: Journal of Education and e-Learning Research
              Type: main
ResultId 1