Table 2 Figure of merits (FOM), 95% confidence intervals (CI) and standard error (StdErr) for wAFROC metrics. The weighted lesion localization fraction (wLLF score) was retrieved at an x-axis 0.2 operating point for all readers and CNNs on the wAFROC curve.

From: Lung nodule detection in chest X-rays using synthetic ground-truth data comparing CNN-based diagnosis to human performance

 

wAFROC

 

FOM

CI Lower

CI Upper

StdErr

wLLF

RetinaNet

0.81

0.75

0.87

0.028

0.71

U-Net

0.58

0.47

0.68

0.052

0.41

Reader 1

0.82

0.79

0.86

0.017

0.71

Reader 2

0.87

0.83

0.90

0.017

0.79

Reader 3

0.74

0.68

0.79

0.029

0.57

Reader 4

0.74

0.70

0.78

0.022

0.59

Reader 5

0.78

0.75

0.81

0.015

0.65

Reader 6

0.87

0.83

0.91

0.020

0.79

Reader 7

0.83

0.79

0.88

0.022

0.74

Reader 8

0.54

0.44

0.63

0.048

0.31

Reader 9

0.84

0.79

0.88

0.023

0.75