Table 2 Figure of merits (FOM), 95% confidence intervals (CI) and standard error (StdErr) for wAFROC metrics. The weighted lesion localization fraction (wLLF score) was retrieved at an x-axis 0.2 operating point for all readers and CNNs on the wAFROC curve.
wAFROC | |||||
|---|---|---|---|---|---|
FOM | CI Lower | CI Upper | StdErr | wLLF | |
RetinaNet | 0.81 | 0.75 | 0.87 | 0.028 | 0.71 |
U-Net | 0.58 | 0.47 | 0.68 | 0.052 | 0.41 |
Reader 1 | 0.82 | 0.79 | 0.86 | 0.017 | 0.71 |
Reader 2 | 0.87 | 0.83 | 0.90 | 0.017 | 0.79 |
Reader 3 | 0.74 | 0.68 | 0.79 | 0.029 | 0.57 |
Reader 4 | 0.74 | 0.70 | 0.78 | 0.022 | 0.59 |
Reader 5 | 0.78 | 0.75 | 0.81 | 0.015 | 0.65 |
Reader 6 | 0.87 | 0.83 | 0.91 | 0.020 | 0.79 |
Reader 7 | 0.83 | 0.79 | 0.88 | 0.022 | 0.74 |
Reader 8 | 0.54 | 0.44 | 0.63 | 0.048 | 0.31 |
Reader 9 | 0.84 | 0.79 | 0.88 | 0.023 | 0.75 |