Assessing Validity of the UCR Standardized English Automatic Oral Test in the MEP Monitoring Test
Сохранить в:
| Авторы: | , , |
|---|---|
| Формат: | artículo original |
| Статус: | Versión publicada |
| Дата публикации: | 2026 |
| Описание: | The Program of the Evaluation of Foreign Languages (PELEx) from the University of Costa Rica is at the forefront of the application of automatic speech recognition (ASR) and artificial intelligence (AI) in the assessment of foreign languages within Latin America (LATAM), creating a need for continual research, data collection, and reliability assessment to collect further evidence of validity for these tests. This paper compares the results obtained during the application of Costa Rica’s Ministry of Public Education (MEP) Monitoring Test in 2023 by PELEx of the University of Costa Rica (UCR) with those of 7,454 Costa Rican public high school students through a statistical sampling of the tests, compared with the grading of a certified human tester from PELEx, to produce evidence of the test’s concurrent validity—specifically, the degree of agreement between human and AI scores. It offers an analysis of the ratings as well as recommendations for further validation research and continued collection of evidence of construct validity and scoring reliability for the AI-based oral exam. |
| Страна: | Portal de Revistas UCR |
| Институт: | Universidad de Costa Rica |
| Repositorio: | Portal de Revistas UCR |
| Язык: | Inglés |
| OAI Identifier: | oai:portal.revistas.ucr.ac.cr:article/8575 |
| Online-ссылка: | https://revistas.ucr.ac.cr/index.php/rrlm/article/view/8575 |
| Ключевое слово: | Artificial Intelligence Foreign Language Evaluation Test Validity Speaking Assessment Inteligencia Artificial Evaluación de Lenguas Extranjeras Validez de Pruebas Evaluación del Habla |