Reliability of Essay Ratings: A Study on Generalizability Theory
Articles > Article ยท 2019
Authors: Hakan ATILGAN
EURASIAN JOURNAL OF EDUCATIONAL RESEARCH, Journal Indexed in SCI Expanded, International, 2019, vol 19, pp 1-18
Summary
Purpose: This study intended to examine the generalizability and reliability of essay ratings within the scope of the generalizability (G) theory. Specifically, the effect of raters on the generalizability and reliability of students' essay ratings was examined. Furthermore, variations of the generalizability and reliability coefficients with respect to the number of raters and optimal number of raters for obtaining optimal reliability of the rating of the writing ability of a student, which is considered to be an implicit trait as a whole and in its sub-dimensions of wording/writing, paragraph construction, and title selection, were determined.