Percent Agreement, Pearson's Correlation, and Kappa as Measures of Inter-examiner Reliability

作者：Ronald J. Hunt · 发表于：Journal of Dental Research · 年份：1986 · DOI：10.1177/00220345860650020701 · 被引用次数：279 · 研究领域：Reliability and Agreement in Measurement、Hemodynamic Monitoring and Therapy、Multi-Criteria Decision Making

Percent agreement and Pearson's correlation coefficient are frequently used to represent inter-examiner reliability, but these measures can be misleading. The use of percent agreement to measure inter-examiner agreement should be discouraged, because it does not take into account the agreement due solely to chance. Caution must be used in the interpretation of Pearson's correlation, because it is unaffected by the presence of any systematic biases. Analyses of data from a reliability study show that even though percent agreement and kappa were consistently high among three examiners, the reliability measured by Pearson's correlation was inconsistent. This study shows that correlation and kappa can be used together to uncover non-random examiner error.