Electronic Assessment Anxiety Scale: Development, Validity and Reliability
Saved in:
| Title: | Electronic Assessment Anxiety Scale: Development, Validity and Reliability |
|---|---|
| Language: | English |
| Authors: | Osman Tat (ORCID |
| Source: | Turkish Online Journal of Distance Education. 2024 25(4):17-32. |
| Availability: | Anadolu University. Office of the Rector, Eskisehir, 26470, Turkey. Tel: +90-222-335-34-53; Fax: +90-222-335-34-86; e-mail: rektor@anadolu.edu.tr; e-mail: TOJDE@anadolu.edu.tr; Web site: http://tojde.anadolu.edu.tr/ |
| Peer Reviewed: | Y |
| Page Count: | 16 |
| Publication Date: | 2024 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Test Construction, Test Validity, Test Reliability, Anxiety, Computer Assisted Testing, Barriers, Social Isolation, Undergraduate Students, Foreign Countries, Test Theory |
| Geographic Terms: | Turkey |
| ISSN: | 1302-6488 |
| Abstract: | The widespread availability of internet access in daily life has resulted in a greater acceptance of online assessment methods. E-assessment platforms offer various features such as randomizing questions and answers, utilizing extensive question banks, setting time limits, and managing access during online exams. Electronic assessment enables real-time monitoring, customization, and scalability of feedback, benefiting students, academic staff, and administrative personnel. However, students encounter specific challenges in the electronic assessment environments. These challenges include limited control over test settings and the isolated nature of taking exams without peers. Furthermore, the technological proficiency of both instructors and students, along with resource constraints (computers, mobile devices, internet), can impede the effective utilization of these assessment tools. Technical issues like slow internet connection or disconnections can have significant consequences, especially in online exams, posing difficulties for corrections. The main goal of this study is to develop a Likert-type scale capable of measuring anxiety related to technical issues, social isolation, and the test interface experienced in e-assessment contexts. The study consists of two separate groups: the first group comprising 359 participants and the second group consisting of 356 participants. Both groups include undergraduate and pedagogical formation certificate program students from a university in the Eastern Anatolia Region of Turkiye. Construct validity was assessed through exploratory and confirmatory factor analyses. Item parameters were examined using item analysis based on classical test theory. As a result of the study, a two-factor scale structure comprising 21 items measuring social and technical anxiety was developed. These two dimensions account for 59.89% of the total variance. The Cronbach's alpha coefficient for the entire scale was 0.93, the McDonald's omega coefficient was 0.93, and the construct reliability was 0.99. |
| Abstractor: | As Provided |
| Entry Date: | 2024 |
| Accession Number: | EJ1444587 |
| Database: | ERIC |
| FullText | Links: – Type: pdflink Url: https://content.ebscohost.com/cds/retrieve?content=AQICAHj0k_4E0hTGH8RJwT4gCJyBsGNe_WN95AvKlDbXJGqwxwF5sV6BsUyCB5w3Vjj27OeJAAAA4jCB3wYJKoZIhvcNAQcGoIHRMIHOAgEAMIHIBgkqhkiG9w0BBwEwHgYJYIZIAWUDBAEuMBEEDMyVAIshDn1ObSpAogIBEICBmqXObEBtnpqT4Nly4WsbhxiubxQNXPepRSprcQJK6y_BTATXR7T3pdEAuNRrIjFFA3El-BsuGEDfJjmKNwks6WURMmzr-ggAmlyfQiwReJ8RM_3LJXygyNkfJnb5sXnCSxyi5RrkFcMsZIcnBmVgrxWDVHr5G3rqWh2k1c3_kOk88mm3sQI1GtzeH9CW0WieeVvhU22PptKLDtI= Text: Availability: 0 CustomLinks: – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1444587 Name: ERIC Full Text Category: fullText Text: Full Text from ERIC |
|---|---|
| Header | DbId: eric DbLabel: ERIC An: EJ1444587 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Electronic Assessment Anxiety Scale: Development, Validity and Reliability – Name: Language Label: Language Group: Lang Data: English – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Osman+Tat%22">Osman Tat</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-2950-9647">0000-0003-2950-9647</externalLink>)<br /><searchLink fieldCode="AR" term="%22Abdullah+Faruk+Kilic%22">Abdullah Faruk Kilic</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-3129-1763">0000-0003-3129-1763</externalLink>) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="SO" term="%22Turkish+Online+Journal+of+Distance+Education%22"><i>Turkish Online Journal of Distance Education</i></searchLink>. 2024 25(4):17-32. – Name: Avail Label: Availability Group: Avail Data: Anadolu University. Office of the Rector, Eskisehir, 26470, Turkey. Tel: +90-222-335-34-53; Fax: +90-222-335-34-86; e-mail: rektor@anadolu.edu.tr; e-mail: TOJDE@anadolu.edu.tr; Web site: http://tojde.anadolu.edu.tr/ – Name: PeerReviewed Label: Peer Reviewed Group: SrcInfo Data: Y – Name: Pages Label: Page Count Group: Src Data: 16 – Name: DatePubCY Label: Publication Date Group: Date Data: 2024 – Name: TypeDocument Label: Document Type Group: TypDoc Data: Journal Articles<br />Reports - Research – Name: Audience Label: Education Level Group: Audnce Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink> – Name: Subject Label: Descriptors Group: Su Data: <searchLink fieldCode="DE" term="%22Test+Construction%22">Test Construction</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Validity%22">Test Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Reliability%22">Test Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Anxiety%22">Anxiety</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+Assisted+Testing%22">Computer Assisted Testing</searchLink><br /><searchLink fieldCode="DE" term="%22Barriers%22">Barriers</searchLink><br /><searchLink fieldCode="DE" term="%22Social+Isolation%22">Social Isolation</searchLink><br /><searchLink fieldCode="DE" term="%22Undergraduate+Students%22">Undergraduate Students</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink><br /><searchLink fieldCode="DE" term="%22Test+Theory%22">Test Theory</searchLink> – Name: Subject Label: Geographic Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Turkey%22">Turkey</searchLink> – Name: ISSN Label: ISSN Group: ISSN Data: 1302-6488 – Name: Abstract Label: Abstract Group: Ab Data: The widespread availability of internet access in daily life has resulted in a greater acceptance of online assessment methods. E-assessment platforms offer various features such as randomizing questions and answers, utilizing extensive question banks, setting time limits, and managing access during online exams. Electronic assessment enables real-time monitoring, customization, and scalability of feedback, benefiting students, academic staff, and administrative personnel. However, students encounter specific challenges in the electronic assessment environments. These challenges include limited control over test settings and the isolated nature of taking exams without peers. Furthermore, the technological proficiency of both instructors and students, along with resource constraints (computers, mobile devices, internet), can impede the effective utilization of these assessment tools. Technical issues like slow internet connection or disconnections can have significant consequences, especially in online exams, posing difficulties for corrections. The main goal of this study is to develop a Likert-type scale capable of measuring anxiety related to technical issues, social isolation, and the test interface experienced in e-assessment contexts. The study consists of two separate groups: the first group comprising 359 participants and the second group consisting of 356 participants. Both groups include undergraduate and pedagogical formation certificate program students from a university in the Eastern Anatolia Region of Turkiye. Construct validity was assessed through exploratory and confirmatory factor analyses. Item parameters were examined using item analysis based on classical test theory. As a result of the study, a two-factor scale structure comprising 21 items measuring social and technical anxiety was developed. These two dimensions account for 59.89% of the total variance. The Cronbach's alpha coefficient for the entire scale was 0.93, the McDonald's omega coefficient was 0.93, and the construct reliability was 0.99. – Name: AbstractInfo Label: Abstractor Group: Ab Data: As Provided – Name: DateEntry Label: Entry Date Group: Date Data: 2024 – Name: AN Label: Accession Number Group: ID Data: EJ1444587 |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1444587 |
| RecordInfo | BibRecord: BibEntity: Languages: – Text: English PhysicalDescription: Pagination: PageCount: 16 StartPage: 17 Subjects: – SubjectFull: Test Construction Type: general – SubjectFull: Test Validity Type: general – SubjectFull: Test Reliability Type: general – SubjectFull: Anxiety Type: general – SubjectFull: Computer Assisted Testing Type: general – SubjectFull: Barriers Type: general – SubjectFull: Social Isolation Type: general – SubjectFull: Undergraduate Students Type: general – SubjectFull: Foreign Countries Type: general – SubjectFull: Test Theory Type: general – SubjectFull: Turkey Type: general Titles: – TitleFull: Electronic Assessment Anxiety Scale: Development, Validity and Reliability Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Osman Tat – PersonEntity: Name: NameFull: Abdullah Faruk Kilic IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2024 Identifiers: – Type: issn-electronic Value: 1302-6488 Numbering: – Type: volume Value: 25 – Type: issue Value: 4 Titles: – TitleFull: Turkish Online Journal of Distance Education Type: main |
| ResultId | 1 |
