Table 10 Rejection rates (Total, Correct Prediction, and Incorrect Prediction) for various confidence and uncertainty measures when ViT, trained on Stable Diffusion, is tested on Stable Diffusion (SD), MidJourney (MJ), GLIDE (GD), VQDM (VQ), and BigGAN (BG)
Measure | Dataset | Nature | AI | ||||
|---|---|---|---|---|---|---|---|
| Â | Â | Total | Correct | Incorrect | Total | Correct | Incorrect |
Probability | SD | 15.40 | 12.62 | 95.52 | 34.00 | 32.51 | 92.89 |
| Â | MJ | 16.05 | 13.28 | 97.96 | 60.87 | 86.06 | 48.79 |
| Â | GD | 15.75 | 12.89 | 96.59 | 58.68 | 92.62 | 46.49 |
| Â | VQ | 15.47 | 13.12 | 95.88 | 34.85 | 93.60 | 26.46 |
| Â | BG | 15.47 | 12.64 | 97.50 | 26.30 | 97.47 | 21.81 |
| Â | SG | 45.08 | 38.75 | 98.40 | 57.75 | 98.51 | 50.99 |
Total Fisher Information | SD | 8.43 | 5.69 | 87.31 | 16.99 | 15.37 | 81.22 |
| Â | MJ | 9.37 | 6.69 | 88.78 | 42.43 | 68.67 | 29.86 |
| Â | GD | 9.05 | 6.18 | 90.24 | 42.95 | 79.07 | 29.97 |
| Â | VQ | 8.45 | 6.23 | 84.71 | 22.85 | 81.33 | 14.50 |
| Â | BG | 8.95 | 6.16 | 90.00 | 17.23 | 90.45 | 12.62 |
| Â | SG | 30.56 | 23.55 | 89.60 | 36.27 | 88.61 | 27.59 |
Fisher Frobenius Norm | SD | 9.56 | 6.71 | 91.79 | 23.85 | 22.35 | 83.25 |
| Â | MJ | 10.47 | 7.68 | 92.86 | 47.37 | 76.54 | 33.38 |
| Â | GD | 10.10 | 7.16 | 93.17 | 46.08 | 84.68 | 32.22 |
| Â | VQ | 9.47 | 7.12 | 90.00 | 25.02 | 87.47 | 16.10 |
| Â | BG | 9.80 | 6.98 | 91.50 | 18.32 | 92.13 | 13.66 |
| Â | SG | 32.43 | 25.26 | 92.80 | 41.13 | 94.06 | Â |
Fisher Entropy | SD | 10.44 | 8.43 | 68.28 | 12.39 | 10.65 | 81.22 |
| Â | MJ | 10.92 | 8.92 | 69.90 | 41.07 | 51.75 | 35.95 |
| Â | GD | 10.23 | 8.28 | 65.37 | 43.45 | 63.75 | 36.16 |
| Â | VQ | 10.65 | 9.02 | 66.47 | 23.43 | 59.60 | 18.27 |
| Â | BG | 10.72 | 8.71 | 69.00 | 19.25 | 81.74 | 15.31 |
| Â | SG | 37.18 | 31.62 | 84.00 | 39.79 | 64.85 | 35.63 |
Gaussian Process | SD | 15.25 | 12.58 | 92.16 | 15.53 | 13.58 | 92.39 |
| Â | MJ | 15.75 | 13.15 | 92.86 | 60.80 | 68.62 | 57.05 |
| Â | GD | 15.27 | 12.58 | 91.22 | 62.27 | 82.35 | 55.05 |
| Â | VQ | 14.98 | 12.81 | 89.41 | 35.58 | 84.40 | 28.61 |
| Â | BG | 15.18 | 12.48 | 93.50 | 27.15 | 95.22 | 22.86 |
| Â | SG | 54.67 | 50.65 | 98.00 | 64.79 | 93.96 | 61.37 |
Entropy of Expected | SD | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 |
| Â | MJ | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 |
| Â | GD | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 |
| Â | VQ | 99.93 | 99.93 | 100.00 | 99.98 | 100.00 | 99.98 |
| Â | BG | 99.92 | 99.91 | 100.00 | 99.92 | 100.00 | 99.91 |
| Â | SG | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 |
Knowledge Uncertainty | SD | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 |
| Â | MJ | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 |
| Â | GD | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 |
| Â | VQ | 99.95 | 99.97 | 99.41 | 99.98 | 99.87 | 100.00 |
| Â | BG | 99.93 | 99.95 | 99.50 | 99.93 | 99.72 | 99.95 |
| Â | SG | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 | 100.00 |
Combined Uncertainty | SD | 13.00 | 10.24 | 92.54 | 14.22 | 12.19 | 94.92 |
| Â | MJ | 13.45 | 10.84 | 90.82 | 56.38 | 68.26 | 50.69 |
| Â | GD | 12.92 | 10.15 | 91.22 | 57.05 | 80.83 | 48.50 |
| Â | VQ | 12.43 | 10.14 | 91.18 | 31.57 | 83.33 | 24.17 |
| Â | BG | 13.13 | 10.34 | 94.00 | 23.55 | 94.94 | 19.05 |
| Â | SG | 45.93 | 40.08 | 95.20 | 56.83 | 93.07 | 50.82 |