Rasch 측정 모형을 이용한 교양 영어 수업 만족도 설문 도구 타당화 연구

Validation of the scale of satisfaction of college English classes using the Rasch measurement model.

This study aims to develop and validate the scale of undergraduates’ satisfaction of college English classes. For the study, a total of 673 students were pooled. The scale items were written based on the results from focus group interview with 35 students from different disciplines. A wide variety of evidence for the scale validity such as content, internal structure-related, generalizability, and substantive validity was collected through the Rasch modeling. The results are as follows. As evidence of content validity, both item fit measures and point-biserial correlation were acceptable. The Rasch modeling showed, as structural evidence, that the internal structure of the scale is unidimensional. Additionally, most items were found to be generalized to both male and female students without differential item functioning, and the scale displayed high reliability. Lastly, the Rasch analysis, as substantive evidence of validity, showed that the respondents responded appropriately to the rating system as intended by the scale developers. However, the inconsistency was found in item-person map, signifying that the distribution of item difficulty did not cover the whole level of students’ satisfaction, which means that more items to measure a high level of satisfaction of college English class need to be added. More pedagogical implications are discussed in the study.