Table 5 Ablation results of the MTAKD component on the ISIC 2019 dataset.
From: MTAKD: multi-teacher agreement knowledge distillation for edge AI skin disease diagnosis
Loss component | Accuracy (%) | Precision (%) | Recall (%) | F1-score (%) |
|---|---|---|---|---|
Cross-entropy (CE) | 80.17 ± 0.72 | 80.00 ± 0.76 | 80.23 ± 0.82 | 79.86 ± 0.78 |
CE + AAKD | 84.00 ± 0.42 | 83.90 ± 0.39 | 84.00 ± 0.42 | 83.79 ± 0.44 |
CE + RAKD | 85.72 ± 0.62 | 85.59 ± 0.62 | 85.72 ± 0.62 | 85.47 ± 0.70 |
CE + AWKD | 87.13 ± 0.31 | 86.99 ± 0.33 | 87.13 ± 0.31 | 86.93 ± 0.32 |
CE + AWKD + AAKD | 87.27 ± 0.23 | 87.13 ± 0.20 | 87.27 ± 0.23 | 87.10 ± 0.20 |
CE + AWKD + RAKD | 87.31 ± 0.20 | 87.22 ± 0.24 | 87.31 ± 0.20 | 87.16 ± 0.20 |
CE + AWKD + AAKD + RAKD | 87.53 ± 0.34 | 87.42 ± 0.35 | 87.53 ± 0.34 | 87.36 ± 0.34 |
