현직 영어교사의 영어로 진행하는 영어수업능력 평가에 대한 타당도 검증 연구

Validating the assessment of Teaching English in English for contemporary English teachers.

The purpose of this paper is to validate the assessment of teaching English in English (TEE) for English teachers which was conducted by a regional Office of Education in Korea. For the research data 64 English teachers were assessed by three groups of invited raters (twenty-two raters in total): eight native university lecturers, nine Korean university professors and five Korean English teachers. In assessing the teachers’ TEE performances the raters used the TEE rating scale which comprised four domains of TEE: Organizational Skills, English Proficiency, Teaching Skills and Learner’s Activity. In order to investigate the reliability of TEE scoring, the computer program of Facets, which was developed based on the many-facet Rasch measurement (MFRM) model, was used. The analysis results showed that the ratings for the TEE performances of participating English teachers were generally reliable and appropriate, although a few cases of unreliable scoring by a couple of raters were found. A suggestion is made to develop the validation framework for the current TEE assessment in terms of MFRM analysis.