Table 2 Optimal interrater reliability of ratings made using the Zaidi–Dayal and Richards–Jabbour scales.
Zaidi–Dayal scale | Session one | Session two | |
|---|---|---|---|
Optimal two-categories solution | Category one | “Round”, “Oval”, “Egg-shaped”, “Tetragonal”, or “Irregular” | “Round”, “Oval”, “Egg-shaped”, “Tetragonal”, “Pentagonal”, or “Irregular” |
Category two | “Pentagonal” or “Hexagonal” | “Hexagonal” | |
Fleiss’ κ (95% CI) | 0.49 (0.38–0.63) | 0.50 (0.37–0.65) | |
Optimal three-categories solution | Category one | “Round”, “Oval”, “Egg-shaped”, “Tetragonal”, or “Irregular” | “Round” |
Category two | “Pentagonal” | “Oval”, “Egg-shaped”, “Tetragonal”, “Pentagonal”, or “Irregular” | |
Category three | “Hexagonal” | “Hexagonal” | |
Fleiss’ κ (95% CI) | 0.46 (0.36–0.58) | 0.43 (0.33–0.56) | |
Optimal four-categories solution | Category one | “Round” | “Round” |
Category two | “Oval”, “Egg-shaped”, “Tetragonal”, or “Irregular” | “Oval”, “Egg-shaped”, “Tetragonal”, “Pentagonal” | |
Category three | “Pentagonal” | “Hexagonal” | |
Category four | “Hexagonal” | “Irregular” | |
Fleiss’ κ (95% CI) | 0.42 (0.34–0.54) | 0.40 (0.31–0.53) | |
Optimal five-categories solution | Category one | “Round” | “Round” |
Category two | “Oval”, “Egg-shaped”, or “Tetragonal” | “Oval”, “Egg-shaped”, or “Tetragonal” | |
Category three | “Pentagonal” | “Pentagonal” | |
Category four | “Hexagonal” | “Hexagonal” | |
Category five | “Irregular” | “Irregular” | |
Fleiss’ κ (95% CI) | 0.40 (0.32–0.54) | 0.37 (0.27–0.47) | |
Optimal six-categories solution | Category one | “Round” | “Round” |
Category two | “Oval” or “Egg-shaped” | “Oval” or “Egg-shaped” | |
Category three | “Tetragonal” | “Tetragonal” | |
Category four | “Pentagonal” | “Pentagonal” | |
Category five | “Hexagonal” | “Hexagonal” | |
Category six | “Irregular” | “Irregular” | |
Fleiss’ κ (95% CI) | 0.37 (0.29–0.46) | 0.33 (0.25–0.42) | |
Richards–Jabbour scale | Session one | Session two | |
Optimal two-categories solution | Category one | Circular, “Two semicircles”, “Wide oval”, “Bi-rounded oval”, or “Bi-pointed oval” | Circular, “Two semicircles”, “Wide oval”, “Bi-rounded oval”, “Ventrally wide oval”, “Bi-pointed oval”, or “Dorsally convergent oval” |
Category two | “Heart-like”, “Ventrally wide oval”, or “Dorsally convergent oval” | “Heart-like” | |
Fleiss’ κ (95% CI) | 0.30 (0.18–0.49) | 0.33 (0.19–0.45) | |
Optimal three-categories solution | Category one | Circular | Circular |
Category two | “Two semicircles”, “Wide oval”, “Bi-rounded oval”, or “Bi-pointed oval” | “Two semicircles”, “Wide oval”, “Bi-rounded oval”, “Ventrally wide oval”, “Bi-pointed oval”, or “Dorsally convergent oval” | |
Category three | “Heart-like”, “Ventrally wide oval”, or “Dorsally convergent oval” | “Heart-like” | |
Fleiss’ κ (95% CI) | 0.27 (0.16–0.41) | 0.26 (0.16–0.37) | |
Optimal four-categories solution | Category one | Circular | Circular, “Two semicircles”, or “Ventrally wide oval” |
Category two | “Two semicircles”, “Wide oval”, “Bi-rounded oval”, or “Bi-pointed oval” | “Heart-like” | |
Category three | “Heart-like” or “Dorsally convergent oval” | “Wide oval”, “Bi-rounded oval”, or “Bi-pointed oval” | |
Category four | “Ventrally wide oval” | “Dorsally convergent oval” | |
Fleiss’ κ (95% CI) | 0.23 (0.16–0.32) | 0.22 (0.15–0.34) | |
Optimal five-categories solution | Category one | Circular | Circular, “Two semicircles”, or “Ventrally wide oval” |
Category two | “Two semicircles”, “Wide oval”, “Bi-rounded oval”, or “Bi-pointed oval” | “Heart-like” | |
Category three | “Heart-like” | “Wide oval” | |
Category four | “Ventrally wide oval” | “Bi-rounded oval” or “Bi-pointed oval” | |
Category five | “Dorsally convergent oval” | “Dorsally convergent oval” | |
Fleiss’ κ (95% CI) | 0.20 (0.14–0.28) | 0.19 (0.14–0.28) | |
Optimal six-categories solution | Category one | Circular, “Two semicircles”, or “Wide oval” | Circular, “Two semicircles”, or “Ventrally wide oval” |
Category two | “Heart-like” | “Heart-like” | |
Category three | “Bi-rounded oval” | “Wide oval” | |
Category four | “Ventrally wide oval” | “Bi-rounded oval” | |
Category five | “Bi-pointed oval” | “Bi-pointed oval” | |
Category six | “Dorsally convergent oval” | “Dorsally convergent oval” | |
Fleiss’ κ (95% CI) | 0.18 (0.13–0.26) | 0.17 (0.13–0.26) | |
Optimal seven-categories solution | Category one | Circular | Circular or “Two semicircles” |
Category two | “Two semicircles” | “Heart-like” | |
Category three | “Heart-like” or “Dorsally convergent oval” | “Wide oval” | |
Category four | “Wide oval” | “Bi-rounded oval” | |
Category five | “Bi-rounded oval” | “Ventrally wide oval” | |
Category six | “Ventrally wide oval” | “Bi-pointed oval” | |
Category seven | “Bi-pointed oval” | “Dorsally convergent oval” | |
Fleiss’ κ (95% CI) | 0.16 (0.11–0.20) | 0.14 (0.10–0.21) | |
