How question shuffling influences correlation of student item selections in computer-bases test

Handling Computer Based Test (CBT) in large classroom requires more of test reliability. Because of limited space assigned to each student, computer monitors are positioned close together so that reliability of exam goes under question also the environment makes student vulnerable to copy from their neighbors. A method to deter students from copying answers of their colleagues is to shuffle items in multiple choice questions. Objective of this study is compare student selected items and questions before and after randomizing assessment of multiple choice test to emphasize that reordering questions can set an environment to discourage students from copying answers of their colleagues in an exam room. This study used existing data from students enrolled in circulation system assessment of Pusan National University School of Medicine over two academic semester year of 2013 and 2016 and measured for correlation coefficient of pre and post randomization. Statistically significant relationship between selected items were found in favor of item shuffling in CBT.