View in EDS

A Scale Development Study for the Evaluation of Digital Content

Saved in:
Bibliographic Details
Title: A Scale Development Study for the Evaluation of Digital Content
Language: English
Authors: Onur Duran (ORCID 0000-0002-8662-8813), Ayse Oguz Unver (ORCID 0000-0003-2938-5269)
Source: International Journal of Technology in Education. 2025 8(2):482-501.
Availability: International Society for Technology, Education, and Science. ISTES Organization, Monument, CO 80132. e-mail: istesorganization@gmail.com; e-mail: ijteoffice@gmail.com; Web site: https://www.ijte.net/index.php/ijte/about
Peer Reviewed: Y
Page Count: 21
Publication Date: 2025
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Scoring Rubrics, Web 2.0 Technologies, Validity, Reliability, Preservice Teachers, Science Teachers, Instructional Materials, Technology Uses in Education, Foreign Countries
Geographic Terms: Turkey
ISSN: 2689-2758
Abstract: This study aimed to develop a rubric for evaluating digital contents specifically Web 2.0 tools in education to improve the quality of digital content, as well as to assess the rubric's validity and reliability. Data were collected from pre-service science teachers in their third year. In the development process, expert opinions were sought, and the rubric's items, criteria, and proficiency levels were created based on relevant literature. The draft rubric was used to evaluate digital contents prepared by these pre-service teachers, followed by analyzes to ensure validity and reliability. Exploratory Factor Analysis (EFA), Confirmatory Factor Analysis (CFA), Cronbach's Alpha, and Kappa analyzes were performed on the collected data. EFA revealed that the 25-item rubric explained 52.70% of the total variance, with factor loadings between 0.498 and 0.862 across three factors. CFA results showed a X[superscript 2]/sd value of 1.437 and an RMSEA value of 0.071. The rubric's internal consistency was measured with a Cronbach's Alpha coefficient of 0.785. To further assess reliability, kappa analysis indicated a moderate inter-rater agreement with a kappa value of 0.64. Based on these results, the EWES rubric is considered both a valid and reliable evaluation tool.
Abstractor: As Provided
Entry Date: 2025
Accession Number: EJ1472624
Database: ERIC
FullText Text:
  Availability: 0
CustomLinks:
  – Url: https://eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=EJ1472624
    Name: ERIC Full Text
    Category: fullText
    Text: Full Text from ERIC
Header DbId: eric
DbLabel: ERIC
An: EJ1472624
AccessLevel: 3
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: A Scale Development Study for the Evaluation of Digital Content
– Name: Language
  Label: Language
  Group: Lang
  Data: English
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Onur+Duran%22">Onur Duran</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0002-8662-8813">0000-0002-8662-8813</externalLink>)<br /><searchLink fieldCode="AR" term="%22Ayse+Oguz+Unver%22">Ayse Oguz Unver</searchLink> (ORCID <externalLink term="https://orcid.org/0000-0003-2938-5269">0000-0003-2938-5269</externalLink>)
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="SO" term="%22International+Journal+of+Technology+in+Education%22"><i>International Journal of Technology in Education</i></searchLink>. 2025 8(2):482-501.
– Name: Avail
  Label: Availability
  Group: Avail
  Data: International Society for Technology, Education, and Science. ISTES Organization, Monument, CO 80132. e-mail: istesorganization@gmail.com; e-mail: ijteoffice@gmail.com; Web site: https://www.ijte.net/index.php/ijte/about
– Name: PeerReviewed
  Label: Peer Reviewed
  Group: SrcInfo
  Data: Y
– Name: Pages
  Label: Page Count
  Group: Src
  Data: 21
– Name: DatePubCY
  Label: Publication Date
  Group: Date
  Data: 2025
– Name: TypeDocument
  Label: Document Type
  Group: TypDoc
  Data: Journal Articles<br />Reports - Research
– Name: Audience
  Label: Education Level
  Group: Audnce
  Data: <searchLink fieldCode="EL" term="%22Higher+Education%22">Higher Education</searchLink><br /><searchLink fieldCode="EL" term="%22Postsecondary+Education%22">Postsecondary Education</searchLink>
– Name: Subject
  Label: Descriptors
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Scoring+Rubrics%22">Scoring Rubrics</searchLink><br /><searchLink fieldCode="DE" term="%22Web+2%2E0+Technologies%22">Web 2.0 Technologies</searchLink><br /><searchLink fieldCode="DE" term="%22Validity%22">Validity</searchLink><br /><searchLink fieldCode="DE" term="%22Reliability%22">Reliability</searchLink><br /><searchLink fieldCode="DE" term="%22Preservice+Teachers%22">Preservice Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Science+Teachers%22">Science Teachers</searchLink><br /><searchLink fieldCode="DE" term="%22Instructional+Materials%22">Instructional Materials</searchLink><br /><searchLink fieldCode="DE" term="%22Technology+Uses+in+Education%22">Technology Uses in Education</searchLink><br /><searchLink fieldCode="DE" term="%22Foreign+Countries%22">Foreign Countries</searchLink>
– Name: Subject
  Label: Geographic Terms
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Turkey%22">Turkey</searchLink>
– Name: ISSN
  Label: ISSN
  Group: ISSN
  Data: 2689-2758
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: This study aimed to develop a rubric for evaluating digital contents specifically Web 2.0 tools in education to improve the quality of digital content, as well as to assess the rubric's validity and reliability. Data were collected from pre-service science teachers in their third year. In the development process, expert opinions were sought, and the rubric's items, criteria, and proficiency levels were created based on relevant literature. The draft rubric was used to evaluate digital contents prepared by these pre-service teachers, followed by analyzes to ensure validity and reliability. Exploratory Factor Analysis (EFA), Confirmatory Factor Analysis (CFA), Cronbach's Alpha, and Kappa analyzes were performed on the collected data. EFA revealed that the 25-item rubric explained 52.70% of the total variance, with factor loadings between 0.498 and 0.862 across three factors. CFA results showed a X[superscript 2]/sd value of 1.437 and an RMSEA value of 0.071. The rubric's internal consistency was measured with a Cronbach's Alpha coefficient of 0.785. To further assess reliability, kappa analysis indicated a moderate inter-rater agreement with a kappa value of 0.64. Based on these results, the EWES rubric is considered both a valid and reliable evaluation tool.
– Name: AbstractInfo
  Label: Abstractor
  Group: Ab
  Data: As Provided
– Name: DateEntry
  Label: Entry Date
  Group: Date
  Data: 2025
– Name: AN
  Label: Accession Number
  Group: ID
  Data: EJ1472624
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=eric&AN=EJ1472624
RecordInfo BibRecord:
  BibEntity:
    Languages:
      – Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 21
        StartPage: 482
    Subjects:
      – SubjectFull: Scoring Rubrics
        Type: general
      – SubjectFull: Web 2.0 Technologies
        Type: general
      – SubjectFull: Validity
        Type: general
      – SubjectFull: Reliability
        Type: general
      – SubjectFull: Preservice Teachers
        Type: general
      – SubjectFull: Science Teachers
        Type: general
      – SubjectFull: Instructional Materials
        Type: general
      – SubjectFull: Technology Uses in Education
        Type: general
      – SubjectFull: Foreign Countries
        Type: general
      – SubjectFull: Turkey
        Type: general
    Titles:
      – TitleFull: A Scale Development Study for the Evaluation of Digital Content
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Onur Duran
      – PersonEntity:
          Name:
            NameFull: Ayse Oguz Unver
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 01
              Type: published
              Y: 2025
          Identifiers:
            – Type: issn-electronic
              Value: 2689-2758
          Numbering:
            – Type: volume
              Value: 8
            – Type: issue
              Value: 2
          Titles:
            – TitleFull: International Journal of Technology in Education
              Type: main
ResultId 1