영작문 평가 상황에서 학생들의 평가 과정에 대한 연구

Investigating the students’ score-decision in the EFL essay-writing context

This study investigates students’ rating process in the EFL essay-writing context. The current study aims to address the answers to the following research questions: 1) which specific feature do students focus on in holistic score decision? and 2) why do students value such an analytic feature in the holistic score decision? This study uses the mixed-methodology that crosses quantitative-qualitative techniques. 90 students from group A and 108 students from group B rated sample essays in terms of 3 analytic features (organization, content, and language use) and a holistic feature using a scoring guide. After the rating task was over, 15 students were solicited to participate in semi-structured interviews. For Research Question 1, the current study, using intra-class correlation, found that the scores of organization and content were more strongly associated with the holistic score. For Research Question 2, this study suggested that a majority of interviewees concentrated on content and organization because they were aware of their lack of linguistic proficiency. In conclusion, this study proposes that students need to complete a rater training program in order for them to provide in-depth qualitative feedback and reliable scores to their peers.