Table 1 Test set localization performance of saliency methods using DenseNet121
From: Benchmarking saliency methods for chest X-ray interpretation
Pathology | Grad-CAM | Grad-CAM++ | Integrated gradients | Eigen-CAM | DeepLIFT | LRP | Occlusion |
|---|---|---|---|---|---|---|---|
mIoU | Â | Â | Â | Â | Â | Â | Â |
Airspace opacity | 0.248 | 0.234 | 0.123 | 0.293 | 0.111 | 0.112 | 0.242 |
Atelectasis | 0.254 | 0.245 | 0.116 | 0.267 | 0.126 | 0.109 | 0.250 |
Cardiomegaly | 0.452 | 0.346 | 0.160 | 0.379 | 0.167 | 0.150 | 0.312 |
Consolidation | 0.408 | 0.296 | 0.177 | 0.332 | 0.088 | 0.099 | 0.212 |
Edema | 0.362 | 0.388 | 0.073 | 0.370 | 0.059 | 0.047 | 0.347 |
Enlarged cardiom. | 0.379 | 0.400 | 0.154 | 0.372 | 0.109 | 0.117 | 0.363 |
Lung lesion | 0.101 | 0.089 | 0.107 | 0.089 | 0.072 | 0.088 | 0.087 |
Pleural effusion | 0.235 | 0.195 | 0.088 | 0.249 | 0.090 | 0.082 | 0.215 |
Pneumothorax | 0.213 | 0.216 | 0.077 | 0.218 | 0.084 | 0.066 | 0.214 |
Support devices | 0.163 | 0.133 | 0.099 | 0.116 | 0.086 | 0.052 | 0.126 |
Hit rate | Â | Â | Â | Â | Â | Â | Â |
Airspace opacity | 0.498 | 0.558 | 0.606 | 0.566 | 0.528 | 0.566 | 0.367 |
Atelectasis | 0.501 | 0.621 | 0.520 | 0.530 | 0.415 | 0.468 | 0.343 |
Cardiomegaly | 0.903 | 0.732 | 0.697 | 0.709 | 0.610 | 0.644 | 0.515 |
Consolidation | 0.738 | 0.708 | 0.624 | 0.626 | 0.571 | 0.283 | 0.338 |
Edema | 0.746 | 0.781 | 0.300 | 0.758 | 0.468 | 0.156 | 0.469 |
Enlarged cardiom. | 0.818 | 0.630 | 0.704 | 0.612 | 0.469 | 0.594 | 0.767 |
Lung lesion | 0.290 | 0.290 | 0.423 | 0.146 | 0.497 | 0.356 | 0.072 |
Pleural effusion | 0.507 | 0.347 | 0.332 | 0.439 | 0.408 | 0.283 | 0.291 |
Pneumothorax | 0.392 | 0.489 | 0.801 | 0.195 | 0.801 | 0.697 | 0.297 |
Support devices | 0.355 | 0.364 | 0.491 | 0.216 | 0.598 | 0.264 | 0.189 |