Extended Data Table 2 Overview of pitfall sources for semantic segmentation metrics ((a): overlap-based metrics, (b): boundary-based metrics) related to poor metric selection [P2]

From: Understanding metric-related pitfalls in image analysis validation

  1. A warning sign indicates a potential pitfall for the metric in the corresponding column, in case the property represented by the respective row holds true. Comprehensive illustrations of pitfalls are available in Supplementary Note 2. A comprehensive list of pitfalls is provided separately for each metrics in the metrics cheat sheets (Supplementary Note 3). Note that we only list sources of pitfalls relevant to the considered metrics. Other sources of pitfalls are neglected for this table. (a) Overlap-based metrics. Considered metrics: centerline Dice Similarity Coefficient (clDice) (Fig. SN 3.40), Dice Similarity Coefficient (DSC) (Fig. SN 3.41), Fβ Score (Fig. SN 3.43), Intersection over Union (IoU) (Fig. SN 3.45). (b) Boundary-based metrics. Considered metrics: Average Symmetric Surface Distance (ASSD) (Fig. SN 3.58), Boundary Intersection over Union (Boundary IoU) (Fig. SN 3.59), Hausdorff Distance (HD) (Fig. SN 3.60), Hausdorff Distance 95th Percentile (HD95) (Fig. SN 3.63), Mean Average Surface Distance (MASD) (Fig. SN 3.61), Normalized Surface Distance (NSD) (Fig. SN 3.62).
Back to article page