KPG research
Script raters
Script raters’ views about the rating procedure, the script rating training, the script rater tools and their marking experience are also explored through the use of questionnaires completed at the end of the script rating procedure. In order to assess the quality of script evaluation, the ways in which script raters use evaluation criteria are systematically observed, inter-relater reliability is conducted and the characteristics of the scripts which cause serious problems in inter-relater reliability are thoroughly examined.