대학 입학사정관의 평가 전문성 측정도구 개발 및 타당화

Developing and Validating the Scale of Evaluation Expertise for Admission Officers

본 연구의 목적은 입학사정관의 평가 전문성 수준을 정확히 파악할 수 있는 측정도구를 개발하고 타당화하는 것이다. 이를 위해 36개 문항으로 구성된 측정도구를 개발하여 106명의 대학 전임 입학사정관들에게 실시하였다. 개발된 측정도구의 타당도 검증을 위해 Rasch 모형에 기반하여 문항적합도 분석을 실시하여 부적합 문항으로 판별된 2개 문항을 삭제하였고, 탐색적 요인분석 결과로 요인구조에 적합하지 않은 문항 4개를 추가적으로 제외시켰다. 결과적으로 총 30개 문항으로 구성된 측정도구는 5개(전형자료의 평가 및 분석, 평가기준과 지침의 이해 및 설정, 대입전형의 이해 및 설계, 대학 전공의 이해, 고교 교육현장의 이해)의 요인구조를 보여주었다. 또한 신뢰도 분석 결과로 요인별 α값이 .888~.948로 높은 수준을 보여주었다.

This study aims to develop and validate the scale of evaluation expertise for admission officers. For this study, a questionnaire consisting of 36 items was administered to 106 full-time admission officers. To analyze the data, the item fit analysis was made with WINSTEPS which was based upon Rasch model. Also, exploratory factor analysis and confirmatory factor analysis were done to validate the scale. The results showed that admission officers’ evaluation expertise consisted of five domains (evaluation and analysis of materials, understanding of evaluation criteria and standards, understanding and designing of admission types, understanding of university academic majors, and understanding of high school education). Cronbach-α proved that the scale developed in this study was reliable. The descriptive statistics of items and five domains revealed that admission officers tended to have difficulties in understanding of university academic majors. Finally, admission officers’ evaluation expertise was found to be associated with their age and career experiences In consequence, the results of this study are expected to help to conceptualize admission officers’ evaluation expertise and apply the scale to enhance the level of admission officers’ evaluation expertise.