Essay raters' personality types and rater reliability
Journal: International Journal of Language Studies (Vol.5, No. 4)Publication Date: 2011-10-01
Authors : Abbas Ali REZAEE; Elham KERMANI;
Page : 109-122
Keywords : Reliability; Rater Reliability; Personality; Personality Type; Guideline Presentation;
Abstract
There is a consensus among the scholars that rater reliability is of a critical importance in rating subjective tests like an essay. Raters’ variances in their judgments as the main threat to rater reliability have been attributed to different sources, all of which have the complex factor of rater individuality at their core. Based on this, it is argued in this study that essay raters’ personality types can influence the degree of intra-rater reliability in scoring compositions. Guideline presentation effect on reliability has also been measured. Thirty raters participated in the current study and the NEO-FFI was used to measure their personality types. The results indicated a degree of relationship between raters’ gender and personality types and their intra-rater reliabilities. However, no significant relationship was found between the guideline presentation and their inter-rater reliabilities.
Other Latest Articles
- The Quantum Human Computer Hypothesis and Radical Minimalism: A brief introduction to Quantum Linguistics
- A corpus based study of discourse markers in British and Pakistani speech
- United Arab Emirates (UAE) high school students’ motivation to read in English as a foreign language
- Temperament as an indicator of language achievement
- Extracting noun forms: A lesson learnt
Last modified: 2014-01-27 20:06:25