Summary of kappa statistic (k) and 95% CIs of independent reviewers, consultants, CRAs and between CRA and consultants for all total case reviews, 4 weeks and 2 weeks prior to death using the cause of death attribution system
| Inter-rater comparison | Total k (95% CI) | 4 weeks k (95% CI) | 2 weeks k (95% CI) |
| Independent reviewers* | 0.92 (0.83 to 0.98) | 0.91 (0.76 to 1.00) | 0.92 (0.79 to 1.00) |
| Consultants† | 0.85 (0.67 to 0.97) | 0.85 (0.59 to 1.00) | 0.84 (0.59 to 1.00) |
| CRA† | 0.96 (0.87 to 1.00) | 0.85 (0.59 to 1.00) | 0.85 (0.60 to 1.00) |
| CRA versus consultants† | 0.86 (0.72 to 0.97) | 0.87 (0.66 to 1.00) | 0.86 (0.67 to 1.00) |
*Calculated using the Fleiss’ kappa statistic (between four reviewers).
†Calculated using the Cohen’s kappa statistic (between two reviewers or two groups).
CRA, clinical research associates.