Table 1 Comparative IRR test scores and κ statistic.
From: Online training programs for adults with disabilities: a systematic review
Categories | First IRR | Second IRR | Third IRR | |||
|---|---|---|---|---|---|---|
N studies | Percent | N studies | Percent | N studies | Percent | |
Total items coded individually | 161 | 100 | 160 | 100 | 160 | 100 |
Number of studies included in the screening* | 15 | 69 | 62 | |||
Number of studies excluded in the screening* | 307 | 251 | 258 | |||
Number of agreements included and excluded* | 154 | 95.65 | 150 | 93.17 | 160 | 100 |
Number of studies that required discussion | 7 | 4.35 | 10 | 6.25 | 0 | - |
Lack of agreement after discussion | 0 | 0 | 0 | |||
Agreement after arbitration | NA | NA | NA | NA | NA | NA |
κ Statistic a | 0.74 | 0.80 | 1 | |||
