Project Management

A Program to Automatically Compute Agreement Statistics for an Asymmetric Table

Date Added: Mar 2010
Format: PDF

Cohen's Kappa coefficient is a method for assessing the degree of agreement between two raters. In order to correctly compute agreement statistics, the table must be square and row labels must match corresponding column labels. However, it may happen that one rater does not use one of the categories of a rating scale. That will result in a non-square table. Regular Kappa procedure will not compute the agreement statistics in this case. Beginning with SAS 9, one can make the table square by adding an observation with zero weight in each missing category.