Content Analysis of Statistical Power in Educational Technology Research: Sample Size Matters.

Saved in:
Bibliographic Details
Title: Content Analysis of Statistical Power in Educational Technology Research: Sample Size Matters.
Authors: Li-Ting Chen1, Leping Liu1 litingc@unr.edu
Source: International Journal of Technology in Teaching & Learning. 2019, Vol. 15 Issue 1, p49-75. 27p.
Subject Terms: *Educational technology research, *Technology education, Analysis of variance, Statistical power analysis, Effect sizes (Statistics)
Abstract: In educational technology research, most studies are conducted to explore the effectiveness of using technology to improve teaching and learning. Priori power analysis enables researchers to determine sufficient sample size for achieving adequate statistical power during research planning. Observed power analysis is carried out on completed studies to estimate statistical power. While priori power analysis is recommended for sample size estimation, observed power analysis has been criticized for being incorrect and misleading. To understand current practices of power analysis in the field, we conducted a content analysis on five years' publications in Educational Technology Research and Development from 2014 to 2018, a total of 178 articles. Our findings showed that only two articles (1.1%) reported a priori power analysis and seven articles (4.0%) reported observed power although it is not recommended. To facilitate sample size determination during research planning, we generated sample size tables for various t tests and ANOVAs from G*Power. Best practice recommendations to conduct and report educational technology research are provided. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Technology in Teaching & Learning is the property of Society of International Chinese in Educational Technology (SICET) and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Education Research Complete
Be the first to leave a comment!
You must be logged in first