A Cost-Benefit Analysis of Automatic Item Generation
Saved in:
| Title: | A Cost-Benefit Analysis of Automatic Item Generation |
|---|---|
| Language: | English |
| Authors: | Kosh, Audra E. (ORCID |
| Source: | Educational Measurement: Issues and Practice. Spr 2019 38(1):48-53. |
| Availability: | Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA |
| Peer Reviewed: | Y |
| Page Count: | 6 |
| Publication Date: | 2019 |
| Document Type: | Journal Articles Reports - Evaluative |
| Education Level: | Elementary Secondary Education |
| Descriptors: | Cost Effectiveness, Automation, Test Items, Mathematics Tests, Elementary Secondary Education |
| DOI: | 10.1111/emip.12237 |
| ISSN: | 0731-1745 |
| Abstract: | Automatic item generation (AIG)--a means of leveraging technology to create large quantities of items--requires a minimum number of items to offset the sizable upfront investment (i.e., model development and technology deployment) in order to achieve cost savings. In this cost-benefit analysis, we estimated the cost of each step of AIG and manual item writing and applied cost-benefit formulas to calculate the number of items that would have to be produced before the upfront costs of AIG outweigh manual item writing costs in the context of K-12 mathematics items. Results indicated that AIG is more cost-effective than manual item writing when developing, at a minimum, 173 to 247 items within one fine-grained content area (e.g., fourth- through seventh-grade area of figures). The article concludes with a discussion of implications for test developers and the nonmonetary tradeoffs involved in AIG. |
| Abstractor: | As Provided |
| Entry Date: | 2019 |
| Accession Number: | EJ1209262 |
| Database: | ERIC |
|
Full text is not displayed to guests.
Login for full access.
|
|
Be the first to leave a comment!
