Reader Expectations and the Validity of Composition Scoring: Implications for Componential Scoring

Reader Expectations and the Validity of Composition Scoring: Implications for Componential Scoring

  The validity of writing assessment has greatly improved since performance-based writing tasks have been used as alternative writing tasks. High reliability of scoring has also been demonstrated in numerous essay assessments. A relatively recent dimension of validity that has been called into question in writing assessment is scoring validity. This paper discusses scoring validity, focusing on the question of diverse reader expectations that contribute to doubts about scoring validity. Reader expectations are discussed in categories such as: differing reader views of what is good writing, issues of content conceptualization, characteristics of texts and their effects on readers, and divergent backgrounds and assumptions held by writers and readers. The paper suggests that readers in essay assessments should be aware of these issues. Finally the paper finds implications for scoring validity in holistic and componential scoring and recommends componential scoring as an alternative to holistic scoring where appropriate and feasible.