Validation of a Fidelity Rating Instrument for Consumer-Operated Services

Saved in:
Bibliographic Details
Title: Validation of a Fidelity Rating Instrument for Consumer-Operated Services
Language: English
Authors: Mowbray, Carol T., Bybee, Deborah, Holter, Mark
Source: American Journal of Evaluation. 2006 27(1):9-27.
Availability: SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; Web site: http://sagepub.com.
Peer Reviewed: Y
Page Count: 19
Publication Date: 2006
Document Type: Journal Articles
Reports - Research
Descriptors: Validity, Attitude Measures, Program Effectiveness, Business, Consumer Economics, Evaluation Methods, Program Implementation
DOI: 10.1177/1098214005284971
ISSN: 1098-2140
Abstract: With the emphasis on the use of evidence-based practices has come a need to measure the fidelity of replications to the operations and principles of original models. Recent reviews have focused on methods to develop fidelity measures for evidence-based program models. However, the issue of how to validate such measures has been given scant attention. The research reported here attempted to validate a fidelity rating instrument (FRI) for consumer-operated drop-in centers on the basis of convergent validation methods. That is, fidelity ratings by trained observers were validated in relation to reports about similar concepts from the users of the centers. The authors describe their methods and present results indicating that all but 4 of 14 fidelity variables from the FRI were validated, as hypothesized. The authors discuss the success of this approach as well as its limitations and identify issues in the further development of fidelity measures. (Contains 3 notes and 4 tables.)
Abstractor: Author
Number of References: 39
Entry Date: 2006
Accession Number: EJ734801
Database: ERIC
Description
Abstract:With the emphasis on the use of evidence-based practices has come a need to measure the fidelity of replications to the operations and principles of original models. Recent reviews have focused on methods to develop fidelity measures for evidence-based program models. However, the issue of how to validate such measures has been given scant attention. The research reported here attempted to validate a fidelity rating instrument (FRI) for consumer-operated drop-in centers on the basis of convergent validation methods. That is, fidelity ratings by trained observers were validated in relation to reports about similar concepts from the users of the centers. The authors describe their methods and present results indicating that all but 4 of 14 fidelity variables from the FRI were validated, as hypothesized. The authors discuss the success of this approach as well as its limitations and identify issues in the further development of fidelity measures. (Contains 3 notes and 4 tables.)
ISSN:1098-2140
DOI:10.1177/1098214005284971