A Scale Development Study for the Evaluation of Digital Content
Saved in:
| Title: | A Scale Development Study for the Evaluation of Digital Content |
|---|---|
| Language: | English |
| Authors: | Onur Duran (ORCID |
| Source: | International Journal of Technology in Education. 2025 8(2):482-501. |
| Availability: | International Society for Technology, Education, and Science. ISTES Organization, Monument, CO 80132. e-mail: istesorganization@gmail.com; e-mail: ijteoffice@gmail.com; Web site: https://www.ijte.net/index.php/ijte/about |
| Peer Reviewed: | Y |
| Page Count: | 21 |
| Publication Date: | 2025 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Scoring Rubrics, Web 2.0 Technologies, Validity, Reliability, Preservice Teachers, Science Teachers, Instructional Materials, Technology Uses in Education, Foreign Countries |
| Geographic Terms: | Turkey |
| ISSN: | 2689-2758 |
| Abstract: | This study aimed to develop a rubric for evaluating digital contents specifically Web 2.0 tools in education to improve the quality of digital content, as well as to assess the rubric's validity and reliability. Data were collected from pre-service science teachers in their third year. In the development process, expert opinions were sought, and the rubric's items, criteria, and proficiency levels were created based on relevant literature. The draft rubric was used to evaluate digital contents prepared by these pre-service teachers, followed by analyzes to ensure validity and reliability. Exploratory Factor Analysis (EFA), Confirmatory Factor Analysis (CFA), Cronbach's Alpha, and Kappa analyzes were performed on the collected data. EFA revealed that the 25-item rubric explained 52.70% of the total variance, with factor loadings between 0.498 and 0.862 across three factors. CFA results showed a X[superscript 2]/sd value of 1.437 and an RMSEA value of 0.071. The rubric's internal consistency was measured with a Cronbach's Alpha coefficient of 0.785. To further assess reliability, kappa analysis indicated a moderate inter-rater agreement with a kappa value of 0.64. Based on these results, the EWES rubric is considered both a valid and reliable evaluation tool. |
| Abstractor: | As Provided |
| Entry Date: | 2025 |
| Accession Number: | EJ1472624 |
| Database: | ERIC |
| Abstract: | This study aimed to develop a rubric for evaluating digital contents specifically Web 2.0 tools in education to improve the quality of digital content, as well as to assess the rubric's validity and reliability. Data were collected from pre-service science teachers in their third year. In the development process, expert opinions were sought, and the rubric's items, criteria, and proficiency levels were created based on relevant literature. The draft rubric was used to evaluate digital contents prepared by these pre-service teachers, followed by analyzes to ensure validity and reliability. Exploratory Factor Analysis (EFA), Confirmatory Factor Analysis (CFA), Cronbach's Alpha, and Kappa analyzes were performed on the collected data. EFA revealed that the 25-item rubric explained 52.70% of the total variance, with factor loadings between 0.498 and 0.862 across three factors. CFA results showed a X[superscript 2]/sd value of 1.437 and an RMSEA value of 0.071. The rubric's internal consistency was measured with a Cronbach's Alpha coefficient of 0.785. To further assess reliability, kappa analysis indicated a moderate inter-rater agreement with a kappa value of 0.64. Based on these results, the EWES rubric is considered both a valid and reliable evaluation tool. |
|---|---|
| ISSN: | 2689-2758 |
