KPG research
Relating Language Tests to the Common European Framework: A Case Study of a Reading Comprehension Test
Papageorgiou Spiros
Department of Linguistics and Modern English Language
Lancaster University
Linking assessments is an essential process for the comparability between language qualifications certified by language tests. This study aims at relating the Reading Comprehension module of the KPG, an EFL exam administered by the Greek Ministry of Education, to the Common European Framework of Reference for Languages: Learning, Teaching, Assessment (CEF), published by the Council of Europe (2001).
A linking process was carefully designed based on the Manual for Relating Language Examinations to the Common European Framework of Reference for Languages: Learning, Teaching, Assessment(Council of Europe, 2003). Eleven members of the Language Testing Research Group at Lancaster University were asked to act as judges of the level of the test, the validity and reliability of which was statistically investigated. The present study seeks to establish the extent to which the Manual is a useful instrument in the hands of language testers, as well as the validity of the claim made by the developers of the KPG about the CEF level of the test.
Based on the analysis of the participants answers, the Manual proves to be a valuable instrument, despite some problems met during the linking process. Moreover, the analysis confirmed to a great extent the KPG developers claim about the CEF level of the test. It is expected that the findings of this study will be of use to test developers who want to relate their tests to the CEF and will provide valuable feedback to the authors of the Manual, who will publish its revised version in late 2005/ early2006.