Table 2 Performance deviation for all individual variations (abbreviations as in Fig. 3) compared to the default. “CL Transfer” refers to the centerlines being propagated from the default to the varied configurations. AUC is either displayed with 95\(\%\) CI or the standard deviation over all respective single models or angles.
Task | CL transfer | AUC [%] | Ad2 | Ad4 | TS | Bv40 | Bv44 | Bv49 | |
|---|---|---|---|---|---|---|---|---|---|
Default | Rule-out | Without | 95.72 [94.21, 97.07] | − 0.14 | − 0.15 | − 2.07 | − 0.08 | − 0.08 | − 0.36 |
No ensembling | Rule-out | Without | 94.65 ± 0.74 | + 0.03 | − 0.15 | − 1.98 | + 0.05 | − 0.06 | − 0.23 |
No TTA | Rule-out | Without | 94.59 ± 0.39 | − 0.09 | − 0.04 | − 1.58 | + 0.04 | − 0.15 | − 0.68 |
10% of Data | Rule-out | Without | 86.73 [84.01, 89.52] | + 1.25 | + 1.97 | − 0.40 | + 1.29 | + 1.95 | + 2.41 |
20% of Data | Rule-out | Without | 87.84 [85.00, 90.43] | + 1.07 | + 0.99 | − 0.69 | + 0.78 | + 1.07 | + 1.15 |
Default | Hold-out | Without | 97.11 [96.06, 98.12] | + 0.08 | − 0.04 | − 0.34 | − 0.03 | − 0.06 | − 0.48 |
No ensembling | Hold-out | Without | 96.79 ± 0.18 | + 0.12 | − 0.13 | − 0.44 | − 0.06 | − 0.16 | − 0.62 |
No TTA | Hold-out | Without | 96.66 ± 0.32 | − 0.09 | + 0.08 | − 0.42 | − 0.08 | − 0.30 | − 0.88 |
10% of data | Hold-out | Without | 93.01 [90.97, 94.86] | + 0.39 | + 0.20 | + 0.08 | + 0.14 | − 0.14 | − 0.06 |
20% of data | Hold-out | Without | 96.00 [94.75, 97.20] | − 0.19 | + 0.09 | − 0.57 | − 0.35 | − 0.79 | − 1.01 |
Default | Rule-out | With | 95.72 [94.21, 97.07] | − 0.06 | − 0.04 | − 1.66 | + 0.06 | − 0.06 | − 0.54 |
No ensembling | Rule-out | With | 94.65 ± 0.74 | − 0.05 | − 0.13 | − 1.42 | + 0.12 | + 0.02 | − 0.51 |
No TTA | Rule-out | With | 94.59 ± 0.39 | − 0.12 | − 0.12 | − 2.12 | − 0.11 | − 0.10 | − 0.42 |
10% of data | Rule-out | With | 86.73 [84.01, 89.52] | + 0.05 | + 0.07 | − 0.59 | + 0.75 | + 1.02 | + 1.24 |
20% of data | Rule-out | With | 87.84 [85.00, 90.43] | + 0.13 | − 0.27 | − 1.48 | + 0.52 | + 1.10 | + 0.92 |
Default | Hold-out | With | 97.11 [96.06, 98.12] | − 0.05 | + 0.05 | − 0.20 | − 0.05 | − 0.25 | − 0.71 |
No ensembling | Hold-out | With | 96.79 ± 0.18 | − 0.04 | + 0.02 | − 0.36 | − 0.10 | − 0.30 | − 0.83 |
No TTA | Hold-out | With | 96.66 ± 0.32 | + 0.07 | − 0.10 | − 0.48 | − 0.08 | − 0.17 | − 0.70 |
10% of data | Hold-out | With | 93.01 [90.97, 94.86] | + 0.10 | − 0.18 | − 0.08 | + 0.07 | + 0.11 | − 0.20 |
20% of data | Hold-out | With | 96.00 [94.75, 97.20] | − 0.07 | + 0.10 | − 0.83 | − 0.12 | − 0.33 | − 0.88 |