생성형 인공지능 ChatGPT의 영어 독해 문항 풀이 능력 탐색

Investigating the performance of generative AI ChatGPT’s reading comprehension ability

This study examines the performance of the generative Artificial Intelligence, ChatGPT, in reading comprehension tasks of recent CSAT English tests. For this, several experiments were carried out in which ChatGPT responded to CSAT English reading items from the 2021 to 2023 versions, and the correct answer rates were determined. The study investigates how the correct answer rate might vary by item type and according to the different versions of ChatGPT (3.5 and 4). The findings reveal that ChatGPT-3.5 answered approximately 69% of the reading items correctly, while GPT-4 achieved almost perfect results. Additionally, the study explores whether similar trends are found in other foreign language tests, using TOEFL iBT reading items. The results indicate a similar trend in TOEFL iBT items. The implications for teachers, test developers, and language learners on how to use this generative AI for teaching and learning and for test-preparation purposes are discussed. The study highlights the potential of using AI in the language learning and teaching processes and its potential impact on test development.