Table 2 Model and expert reader sensitivities and specificities of Fig. 2b, stratified by 0-3 h, 3-6 h, and > 6 h symptom (sx) onset-to-NCCT times, in the “MCA-territory only” test set (a-c, calculated at the model’s 0 mL-threshold for infarct detection, for the n = 76 patients for whom onset-to-NCCT time data was available). Overall onset-to-NCCT times ranged from 32 min to 22.9 h, median 3.7 h.
From: Head CT deep learning model is highly accurate for early infarct estimation
Threshold | 0 ml | 20 mL | 50 mL | 70 mL | 100 mL | |
|---|---|---|---|---|---|---|
Sx Onset-to-NCCT 0–3 h (n = 30) | ||||||
Model | Sensitivity | 0.90 (0.79–1.0) | 0.88 (0.76–0.99) | 0.93 (0.84–1.00) | 1.00 (1.00–1.00) | 0.83 (0.70–0.97) |
Specificity | - | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | 0.95 (0.87–1.00) | 0.96 (0.89–1.00) | |
Expert 1 | Sensitivity | 0.47 (0.29–0.65) | 0.25 (0.10–0.40) | 0.14 (0.02–0.27) | – | – |
Specificity | - | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | – | – | |
Expert 2 | Sensitivity | 0.63 (0.46–0.81) | 0.12 (0.01–0.24) | 0.07 (0.00–0.16) | – | – |
Specificity | - | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | – | – | |
Expert 3 | Sensitivity | 0.57 (0.39–0.74) | 0.38 (0.20–0.55) | 0.21 (0.07–0.36) | – | – |
Specificity | - | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | – | – | |
Sx Onset-to-NCCT 3–6 h (n = 37) | ||||||
Model | Sensitivity | 1.00 (1.00–1.00) | 0.95 (0.88–1.00) | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) |
Specificity | - | 0.88 (0.77–0.98) | 0.96 (0.90–1.00) | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | |
Expert 1 | Sensitivity | 0.68 (0.52–0.83) | 0.48 (0.32–0.64) | 0.80 (0.67–0.93) | – | – |
Specificity | - | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | – | – | |
Expert 2 | Sensitivity | 0.68 (0.52–0.83) | 0.52 (0.36–0.68) | 0.40 (0.24–0.56) | – | – |
Specificity | - | 0.94 (0.86–1.00) | 1.00 (1.00–1.00) | – | – | |
Expert 3 | Sensitivity | 0.73 (0.59–0.87) | 0.52 (0.36–0.68) | 0.60 (0.44–0.76) | – | – |
Specificity | - | 0.94 (0.86–1.00) | 0.96 (0.90–1.00) | – | – | |
Sx Onset-to-NCCT > 6 h (n = 9) | ||||||
Model | Sensitivity | 1.00 (1.00–1.00) | – | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) |
Specificity | - | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | |
Expert 1 | Sensitivity | 0.67 (0.36–0.97) | 0.50 (0.17–0.83) | 1.00 (1.00–1.00) | – | – |
Specificity | - | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | – | – | |
Expert 2 | Sensitivity | 0.67 (0.36–0.97) | 0.75 (0.47–1.00) | 1.00 (1.00–1.00) | – | – |
Specificity | - | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | – | – | |
Expert 3 | Sensitivity | 0.67 (0.36–0.97) | 0.50 (0.17–0.83) | 1.00 (1.00–1.00) | – | – |
Specificity | - | 1.00 (1.00–1.00) | 1.00 (1.00–1.00) | – | – | |
