Inter-rater comparison | Total k (95% CI) | 4 weeks k (95% CI) | 2 weeks k (95% CI) |
Independent reviewers* | 0.92 (0.83 to 0.98) | 0.91 (0.76 to 1.00) | 0.92 (0.79 to 1.00) |
Consultants† | 0.85 (0.67 to 0.97) | 0.85 (0.59 to 1.00) | 0.84 (0.59 to 1.00) |
CRA† | 0.96 (0.87 to 1.00) | 0.85 (0.59 to 1.00) | 0.85 (0.60 to 1.00) |
CRA versus consultants† | 0.86 (0.72 to 0.97) | 0.87 (0.66 to 1.00) | 0.86 (0.67 to 1.00) |
*Calculated using the Fleiss’ kappa statistic (between four reviewers).
†Calculated using the Cohen’s kappa statistic (between two reviewers or two groups).
CRA, clinical research associates.