Table 4 Segmentation performance on the external validation set for all three architectures with ensembled predictions.
nnU-Net6 | DSC | IOU | PPV | TPR | LFPR | LTPR | VD |
|---|---|---|---|---|---|---|---|
Liver parenchyma | 0.97 [0.94, 0.99] | 0.94 [0.91, 0.97] | 0.98 [0.96, 1.00] | 0.96 [0.94, 0.99] | – | – | 0.10 [0.02, 0.19] |
Portal vein | 0.85 [0.81, 0.89] | 0.76 [0.71, 0.81] | 0.94 [0.92, 0.96] | 0.80 [0.74, 0.85] | – | – | 0.32 [0.23, 0.42] |
Hepatic veins | 0.83 [0.78, 0.88] | 0.74 [0.68, 0.80] | 0.93 [0.91, 0.95] | 0.78 [0.72, 0.85] | – | - | 0.34 [0.23, 0.45] |
Lesions | 0.55 [0.43, 0.67] | 0.45 [0.32, 0.57] | 0.93 [0.88, 0.98] | 0.48 [0.34, 0.61] | 0.06 [0.00, 0.12] | 0.94 [0.87, 1.00] | 0.90 [0.67, 1.12] |
Ascites | 0.00 [0.00, 0.01] | 0.00 [0.00, 0.01] | 0.42 [0.00, 1.00] | 0.00 [0.00, 0.00] | – | – | 1.73 [0.00, 5.98] |
Abdominal aorta | 0.98 [0.98, 0.99] | 0.98 [0.98, 0.98] | 0.98 [0.98, 0.99] | 0.98 [0.97, 0.99] | – | – | 0.01 [0.01, 0.02] |
Thoracic aorta | 0.97 [0.96, 0.99] | 0.95 [0.94, 0.98] | 0.99 [0.99, 0.99] | 0.97 [0.96, 0.99] | – | – | 0.03 [0.02, 0.04] |
ResEnc nnU-Net21 | |||||||
Liver parenchyma | 0.97 [0.95, 0.99] | 0.94 [0.92, 0.97] | 0.97 [0.95, 0.99] | 0.97 [0.96, 0.99] | - | - | 0.09 [-0.00, 0.18] |
Portal vein | 0.76 [0.70, 0.81] | 0.64 [0.58, 0.70] | 0.92 [0.88, 0.96] | 0.69 [0.63, 0.75] | - | - | 0.61 [0.33, 0.89] |
Hepatic veins | 0.76 [0.71, 0.82] | 0.64 [0.58, 0.70] | 0.90 [0.87, 0.93] | 0.69 [0.63, 0.75] | - | - | 0.46 [0.35, 0.57] |
Lesions | 0.37 [0.24, 0.50] | 0.27 [0.15, 0.40] | 0.87 [0.74, 1.00] | 0.28 [0.15, 0.41] | 0.12 [-0.01, 0.25] | 0.82 [0.67, 0.96] | 1.23 [1.02, 1.45] |
Ascites | 0.02 [0.00, 0.21] | 0.01 [0.00, 0.11] | 0.47 [0.00, 1.00] | 0.01 [0.00, 0.12] | – | – | 1.70 [0.00, 5.80] |
Abdominal aorta | 0.97 [0.96, 0.97] | 0.94 [0.93, 0.95] | 0.98 [0.98, 0.99] | 0.95 [0.95, 0.96] | – | – | 0.07 [0.06, 0.08] |
Thoracic aorta | 0.96 [0.94, 0.97] | 0.92 [0.90, 0.94] | 0.99 [0.99, 1.00] | 0.93 [0.91, 0.95] | – | – | 0.12 [0.08, 0.15] |
Swin UNETR22 | |||||||
Liver parenchyma | 0.92 [0.87, 0.97] | 0.88 [0.82, 0.93] | 0.92 [0.88, 0.96] | 0.93 [0.88, 0.98] | – | – | 0.17 [0.04, 0.30] |
Portal vein | 0.61 [0.55, 0.67] | 0.47 [0.41, 0.52] | 0.71 [0.65, 0.77] | 0.58 [0.52, 0.65] | – | – | 0.70 [0.33, 1.07] |
Hepatic veins | 0.51 [0.44, 0.58] | 0.37 [0.31, 0.43] | 0.67 [0.60, 0.74] | 0.47 [0.39, 0.54] | – | – | 0.76 [0.59, 0.94] |
Lesions | 0.25 [0.14, 0.36] | 0.18 [0.10, 0.27] | 0.36 [0.23, 0.50] | 0.28 [0.16, 0.40] | 0.76 [0.67, 0.85] | 0.77 [0.62, 0.92] | 188 [0.00, 322] |
Ascites | 0.00 [0.00, 0.01] | 0.00 [0.00, 0.00] | 0.27 [0.00, 1.00] | 0.00 [0.00, 0.00] | – | – | 1.36 [0.00, 5.98] |
Abdominal aorta | 0.91 [0.89, 0.92] | 0.83 [0.81, 0.86] | 0.91 [0.89, 0.92] | 0.92 [0.89, 0.94] | – | – | 0.17 [0.11, 0.22] |
Thoracic aorta | 0.84 [0.79, 0.90] | 0.77 [0.70, 0.83] | 0.88 [0.85, 0.92] | 0.85 [0.78, 0.92] | – | – | 0.32 [0.19, 0.45] |