The Effects and Predictive Power of the Diagnostic Assessment and Achievement of College Skills Intervention on Academic Success Indicators

Saved in:
Bibliographic Details
Title: The Effects and Predictive Power of the Diagnostic Assessment and Achievement of College Skills Intervention on Academic Success Indicators
Language: English
Authors: Jason Bryer (ORCID 0000-0002-2454-0402), Heidi L. Andrade, Timothy J. Cleary, Angela M. Lui, David W. Franklin, Diana Akhmedjanova
Source: Educational Technology Research and Development. 2025 73(5):3067-3104.
Availability: Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Peer Reviewed: Y
Page Count: 38
Publication Date: 2025
Sponsoring Agency: Department of Education (ED)
Institute of Education Sciences (ED)
Contract Number: P116F150077
R305A210269
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Secondary Education
Descriptors: Diagnostic Tests, Educational Diagnosis, Prediction, Academic Achievement, College Freshmen, Student Evaluation, Reading Skills, Writing Skills, Mathematics Skills, Independent Study, Study Skills, Feedback (Response), College Preparation, Self Efficacy, Test Anxiety
DOI: 10.1007/s11423-025-10547-1
ISSN: 1042-1629
1556-6501
Abstract: The purpose of this study was to examine the effects and predictive power of the Diagnostic Assessment and Achievement of College Skills (DAACS) on student success. DAACS is an open-source diagnostic assessment tool designed to measure newly enrolled college students' reading, writing, mathematics, and self-regulated learning skills, and to provide individualized feedback and learning resources that students can use to become better prepared for college. A randomized control trial was performed at two online colleges (n = 23,467) to test the effects of DAACS on credit acquisition and retention. The results indicate an overall null effect of treatment, but post hoc analyses reveal two important findings: (1) Students who not only received the assessment results but also accessed the feedback were significantly more likely to earn credits and be retained for a second term than students who only accessed the assessment results; (2) some students who only accessed the assessment results without reading the feedback, particularly those with low scores on the assessments, low self-efficacy, or high test anxiety, had worse outcomes than the control group. We speculate that feedback mitigates the potentially negative effects of testing on student success. In addition, an examination of the predictive power of DAACS indicated that DAACS data significantly strengthen predictions of academic outcomes.
Abstractor: As Provided
Notes: https://github.com/DAACS
IES Funded: Yes
Entry Date: 2026
Accession Number: EJ1497530
Database: ERIC
Description
Abstract:The purpose of this study was to examine the effects and predictive power of the Diagnostic Assessment and Achievement of College Skills (DAACS) on student success. DAACS is an open-source diagnostic assessment tool designed to measure newly enrolled college students' reading, writing, mathematics, and self-regulated learning skills, and to provide individualized feedback and learning resources that students can use to become better prepared for college. A randomized control trial was performed at two online colleges (n = 23,467) to test the effects of DAACS on credit acquisition and retention. The results indicate an overall null effect of treatment, but post hoc analyses reveal two important findings: (1) Students who not only received the assessment results but also accessed the feedback were significantly more likely to earn credits and be retained for a second term than students who only accessed the assessment results; (2) some students who only accessed the assessment results without reading the feedback, particularly those with low scores on the assessments, low self-efficacy, or high test anxiety, had worse outcomes than the control group. We speculate that feedback mitigates the potentially negative effects of testing on student success. In addition, an examination of the predictive power of DAACS indicated that DAACS data significantly strengthen predictions of academic outcomes.
ISSN:1042-1629
1556-6501
DOI:10.1007/s11423-025-10547-1