Table 1 ViTs are more robust to adversarial attacks than ResNets, as measured by the attack success rate (ASR) for the RCC classification task
From: Adversarial attacks and adversarial robustness in computational pathology
É› | Normal models | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
FGSM | PGD | Square | FAB | AutoAttack | É› | AdvDrop | |||||||||||||
ResNet | BiT | ViT | ResNet | BiT | ViT | ResNet | BiT | ViT | ResNet | BiT | ViT | ResNet | BiT | ViT | ResNet | BiT | ViT | ||
0.25e-3 | 13.33% | 16.44% | 2.22% | 14.44% | 16.22% | 2.22% | 5.78% | 2.22% | 0.6% | 12.67% | 19.78% | 2.00% | 13.56% | 19.78% | 2.00% | 20 | 68.67% | 63.11% | 61.56% |
0.75e-3 | 32.67% | 35.56% | 6.44% | 34.67% | 33.78% | 7.33% | 13.56% | 7.56% | 2.00% | 29.78% | 4356% | 6.00% | 33.11% | 44.44% | 6.44% | 40 | 67.56% | 68.44% | 45.11% |
1.50e-3 | 46.00% | 46.00% | 12.89% | 50.22% | 45.56% | 14.44% | 24.00% | 15.78% | 3.11% | 44.44% | 56.44% | 12.00% | 48.67% | 56.89% | 13.33% | 60 | 55.78% | 70.00% | 45.11% |
0.1 | 64.22% | 62.00% | 55.11% | 64.00% | 63.33% | 60.89% | 54.89% | 58.00% | 55.78% | 52.00% | 58.00% | 55.11% | 54.89% | 58.00% | 55.78% | - | - | - | - |
Adversarially trained models | |||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0.25e-3 | 0.70% | 7.11% | 0.90% | 0.70% | 7.11% | 0.90% | 0.22% | 1.33% | 0.44 4% | 0.70% | 9.11% | 0.90% | 0.70% | 9.11% | 0.90% | 20 | 68.89% | 41.78% | 58.22% |
0.75e-3 | 2.89% | 16.00% | 2.00% | 2.89% | 15.33% | 2.00% | 0.67% | 2.89% | 0.90% | 2.89% | 23.33% | 2.00% | 2.89% | 24.44% | 2.00% | 40 | 75.78% | 50.22% | 63.78% |
1.50e-3 | 6.44% | 23.33% | 3.56% | 6.67% | 20.44% | 3.78% | 2.00% | 7.56% | 0.90% | 6.67% | 39.33% | 3.78% | 6.89% | 41.56% | 3.78% | 60 | 75.78% | 51.56% | 64.44% |
0.1 | 62.00% | 42.67% | 51.33% | 72.44% | 55.11% | 60.67% | 61.56% | 47.56% | 50.89% | 60.89% | 47.55% | 54.00% | 62.00% | 47.56% | 54.22% | - | - | - | - |
Winner | ViT | ViT | ViT | ViT | ViT | Â | - | ||||||||||||
t [sec] | 0.08 s | 0.13 s | 0.19 s | 2.51 s | 3.78 s | 4.36 s | 31.56 s | 47.72 s | 30.16 s | 4.10 s | 4.47 s | 5.09 s | 5.30 s | 3.56 s | 6.74 s |  | 5.10 s | 2.14 s | 3.46 s |