Table 1 Comparison of experimental results of various models on the CIFAR-10 dataset.
From: Mixed precision quantization based on information entropy
Model | Method | Weight/Activation Bit Width | Accuracy (%) |
---|---|---|---|
Resnet20 | Baseline | 32/32 | 94.26 |
PACT | 4/4 | 92.589 | |
LSQ | 4/4 | 93.660 | |
LIMPQ | 4MP/4MP | 92.140 | |
Ours | 3.6MP/3.6MP | 94.350 | |
Ours_KD | 3.6MP/3.6MP | 94.360 | |
Resnet32 | Baseline | 32/32 | 94.500 |
PACT | 4/4 | 92.460 | |
LSQ | 4/4 | 93.590 | |
LIMPQ | 4MP/4MP | 93.730 | |
Ours | 3.6MP/3.6MP | 93.920 | |
Ours_KD | 3.6MP/3.6MP | 94.460 | |
Resnet56 | Baseline | 32/32 | 94.080 |
PACT | 4/4 | 92.460 | |
LSQ | 4/4 | 93.410 | |
LIMPQ | 4MP/4MP | 93.270 | |
Ours | 3.6MP/3.6MP | 93.940 | |
Ours_KD | 3.6MP/3.6MP | 94.160 |