Table 6 Ablation results of the MTAKD component on the Fitzpatrick17k-C dataset.
From: MTAKD: multi-teacher agreement knowledge distillation for edge AI skin disease diagnosis
Loss component | Accuracy (%) | Precision (%) | Recall (%) | F1-score (%) |
|---|---|---|---|---|
Cross-entropy (CE) | 35.07 ± 0.57 | 36.86 ± 0.91 | 35.07 ± 0.57 | 34.15 ± 0.73 |
CE + AAKD | 38.06 ± 0.67 | 40.31 ± 0.42 | 38.06 ± 0.67 | 37.83 ± 0.50 |
CE + RAKD | 38.59 ± 0.75 | 40.44 ± 0.71 | 38.59 ± 0.75 | 38.23 ± 0.72 |
CE + AWKD | 44.29 ± 0.33 | 46.04 ± 0.71 | 44.29 ± 0.33 | 43.58 ± 0.26 |
CE + AWKD + AAKD | 44.49 ± 0.32 | 46.25 ± 0.62 | 44.49 ± 0.32 | 43.82 ± 0.33 |
CE + AWKD + RAKD | 44.57 ± 0.39 | 46.33 ± 0.63 | 44.57 ± 0.39 | 43.81 ± 0.38 |
CE + AWKD + AAKD + RAKD | 44.75 ± 0.43 | 46.78 ± 0.42 | 44.75 ± 0.43 | 44.09 ± 0.39 |
