외국인 한국어 말하기 시험의 평가자 요소가 채점에 미치는 영향

A Study of Korean Raters’ Characteristics for Foreign Speakers’ Korean Oral Performance

The study investigated the effects of raters’ experience on the validity and reliability for foreign speakers’ Korean speaking assessment. Twelve professional Korean and twelve non-professional Korean raters assessed twenty-seven Korean learners’ oral performance. For the quantitative analysis the FACETS program with multi-facets Rasch model was carried out. The results are as follows: (1) professional raters tended to assess strictly rather than non-professional raters, (2) the strict assessment was realized on the open-ended response task, while the relaxed assessment was found on the opinion response and story-telling response tasks, and (3) both groups evaluated strictly on the grammar section, while they gave higher scores to the questions on the cohesive discourse section. The study also found that some professional raters caused problems of reliability and validity on their assessment. Other non-professional raters, on the other hand, tended to show over-fitted or under-fitted assessment. The result implies that raters should take the assessment training before participating in the real assessment.