반직접영어말하기 시험에서 평가과업과 평가영역의 탐색

Exploring test tasks and features in the semi-directed speaking test: Using a FACETS analysis

The current study was designed to examine the task and the feature dimension in semi-directed speaking test, using the multi-facets Rasch model. One hundred university students with varying majors joined in this study. Based on the result of the interview test, students were divided into the high and the low proficient group. Then, they made their oral responses on the picture-description, introduction, and procedure-description task in semi-directed oral test. Two expert raters scored students utterances with reference to accuracy, task fulfilment, and fluency. The results showed that students obtained relatively low scores in the picture-description task and in accuracy. This study also showed that task difficulty and feature difficulty differed from the high to the low proficient group. Regarding the fit statistics, while all tasks were judged as infit tasks, task fulfillment was categorized as the misfitting feature. This study suggested that the task fulfilment needs to be revised or discarded for enhanced psychometric validity of the speaking test.