View in EDS HTML Full Text PDF Full Text

Assessing the Validity of Can-Do Statements in Retrospective (Then-Now) Self-Assessment

Saved in:
Bibliographic Details
Title: Assessing the Validity of Can-Do Statements in Retrospective (Then-Now) Self-Assessment
Language: English
Authors: Brown, N. Anthony, Dewey, Dan P., Cox, Troy L.
Source: Foreign Language Annals. Sum 2014 47(2):261-285.
Availability: Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Peer Reviewed: Y
Page Count: 25
Publication Date: 2014
Document Type: Journal Articles
Reports - Research
Descriptors: Self Evaluation (Individuals), Pretests Posttests, Interviews, Language Proficiency, Oral Language, Language Tests, Correlation, Predictive Validity, Item Analysis, Internship Programs, Foreign Countries, Achievement Gains, Russian, Second Language Learning, Student Attitudes, Test Reliability
Geographic Terms: Russia
DOI: 10.1111/flan.12082
ISSN: 0015-718X
Abstract: In this study, the authors evaluated the strengths and limitations of a self-assessment based on ACTFL Can-Do statements ("ACTFL," 2013]) as a tool for measuring linguistic gains over an internship abroad in Russia. They assessed its reliability, determined how its items mapped with the ACTFL scale, and measured the degree to which students' self-evaluations matched oral proficiency interview (OPI) test results (i.e., predictive validity). Data revealed a high level of reliability. Furthermore, self-assessment items ascended in the order of difficulty expected (i.e., Superior items were the most difficult, followed by Advanced), but differences between the means for items representing the ACTFL levels were not statistically significant. Finally, while students demonstrated significant gains from pre- to posttests on both the OPI and the self-assessment, correlations between these measures were only moderate.
Abstractor: As Provided
Entry Date: 2014
Accession Number: EJ1031126
Database: ERIC
Full text is not displayed to guests.
Description
Abstract:In this study, the authors evaluated the strengths and limitations of a self-assessment based on ACTFL Can-Do statements ("ACTFL," 2013]) as a tool for measuring linguistic gains over an internship abroad in Russia. They assessed its reliability, determined how its items mapped with the ACTFL scale, and measured the degree to which students' self-evaluations matched oral proficiency interview (OPI) test results (i.e., predictive validity). Data revealed a high level of reliability. Furthermore, self-assessment items ascended in the order of difficulty expected (i.e., Superior items were the most difficult, followed by Advanced), but differences between the means for items representing the ACTFL levels were not statistically significant. Finally, while students demonstrated significant gains from pre- to posttests on both the OPI and the self-assessment, correlations between these measures were only moderate.
ISSN:0015-718X
DOI:10.1111/flan.12082