ResearchBib Share Your Research, Maximize Your Social Impacts
Sign for Notice Everyday Sign up >> Login

REFORMULATION AND GENERALISATION OF THE COHEN AND FLEISS KAPPAS

Journal: LIFE: International Journal of Health and Life-Sciences (Vol.3, No. 3)

Publication Date:

Authors : ;

Page : 1-15

Keywords : Assessment of consistency and content validity; Fleiss Kappa; Cohen Kappa; ICC; Gwet's AC1 coefficient; Multi-rater assessments; CVI.;

Source : Downloadexternal Find it from : Google Scholarexternal

Abstract

The assessment of consistency in the categorical or ordinal decisions made by observers or raters is an important problem especially in the medical field. The Fleiss Kappa, Cohen Kappa and Intra-class Correlation (ICC), as commonly used for this purpose, are compared and a generalised approach to these measurements is presented. Differences between the Fleiss Kappa and multi-rater versions of the Cohen Kappa are explained and it is shown how both may be applied to ordinal scoring with linear, quadratic or other weighting. The relationship between quadratically weighted Fleiss and Cohen Kappa and pair-wise ICC is clarified and generalised to multi-rater assessments. The AC coefficient is considered as an alternative measure of consistency and the relevance of the Kappas and AC to measuring content validity is explored .

Last modified: 2018-04-26 18:30:32