Table 3 Inter-coder reliability measures for ongoing validation
From: COVID-19 Government Response Event Dataset (CoronaNet v.1.0)
Policy | n | Percentage agreement | Cohen’s kappa (k) |
|---|---|---|---|
Restrictions of mass gatherings | 21 | 95.2 | 0.95 |
Closure of schools | 14 | 92.9 | 0.92 |
Restriction of non-essential businesses | 19 | 89.5 | 0.89 |
External border restrictions | 52 | 84.6 | 0.83 |
Curfew | 6 | 83.4 | 0.82 |
Internal border restrictions | 11 | 81.8 | 0.80 |
Declaration of national emergency | 19 | 73.7 | 0.71 |
Quarantine/lockdown | 28 | 67.9 | 0.65 |
Health measures | 52 | 65.4 | 0.63 |
Restriction of non-essential government services | 16 | 62.5 | 0.59 |
New task force, bureau or administrative configuration | 9 | 55.6 | 0.52 |
Public awareness measures | 15 | 53.3 | 0.49 |
Social Distancing | 14 | 42.9 | 0.38 |
Summary of inter-coder reliability scores | |||
Percentage agreement | 0.74 | ||
Cohen’s kappa | 0.72 | ||
Krippendorff’s alpha | 0.71 | ||
Scott’s pi: estimate (s.e.m.) | 0.71 (0.03) |
