Can the Oral Proficiency Interview ‐ Computer (ACTFL OPIc) be used instead of the Oral Proficiency Interview (ACTFL OPI)? An aligned rank transform (ART) analysis.
Saved in:
| Title: | Can the Oral Proficiency Interview ‐ Computer (ACTFL OPIc) be used instead of the Oral Proficiency Interview (ACTFL OPI)? An aligned rank transform (ART) analysis. |
|---|---|
| Authors: | Cox, Troy L.1, Thompson, Gregory L.1 gregory_thompson@byu.edu, Stokes, Steven S.2 |
| Source: | Foreign Language Annals. Jul2025, Vol. 58 Issue 2, p300-325. 26p. |
| Subject Terms: | *Verbal ability, *Language & languages, *Higher education, Linguistics, Spanish language |
| Abstract: | This study investigated the differences between the ACTFL Oral Proficiency Interview (OPI) and the ACTFL Oral Proficiency Interview ‐ Computer (OPIc) among Spanish learners at a U.S. university. Participants (N = 154) were randomly assigned to take both tests in a counterbalanced order to mitigate test order effects. Data were analyzed using an aligned rank transform (ART) analysis, focusing on variables such as gender, age, language courses, missionary experience, and self‐assessed Spanish ability. Results showed a strong correlation between ACTFL OPI and ACTFL OPIc ratings (τ = 0.79, p <.001), though ACTFL OPIc ratings were slightly higher on average. No significant order effects were found, indicating the order of test administration did not influence ratings. The reliability of both tests was confirmed, and no significant biases were detected. The findings suggest that both ACTFL OPI and ACTFL OPIc are effective, holistic measures of Spanish oral proficiency, with ACTFL OPIc offering a slight advantage in rating outcomes. Pedagogically, this suggests flexibility in test choice without compromising assessment integrity. [ABSTRACT FROM AUTHOR] |
| Copyright of Foreign Language Annals is the property of Wiley-Blackwell and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Education Research Complete |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | This study investigated the differences between the ACTFL Oral Proficiency Interview (OPI) and the ACTFL Oral Proficiency Interview ‐ Computer (OPIc) among Spanish learners at a U.S. university. Participants (N = 154) were randomly assigned to take both tests in a counterbalanced order to mitigate test order effects. Data were analyzed using an aligned rank transform (ART) analysis, focusing on variables such as gender, age, language courses, missionary experience, and self‐assessed Spanish ability. Results showed a strong correlation between ACTFL OPI and ACTFL OPIc ratings (τ = 0.79, p <.001), though ACTFL OPIc ratings were slightly higher on average. No significant order effects were found, indicating the order of test administration did not influence ratings. The reliability of both tests was confirmed, and no significant biases were detected. The findings suggest that both ACTFL OPI and ACTFL OPIc are effective, holistic measures of Spanish oral proficiency, with ACTFL OPIc offering a slight advantage in rating outcomes. Pedagogically, this suggests flexibility in test choice without compromising assessment integrity. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 0015718X |
| DOI: | 10.1111/flan.12804 |
