Table 5 Precision, recall, F1-score, and accuracy in the class-wise level.
From: Fault-class coverage–aligned combined training for AFDD of AHUs across multiple buildings
Building | Method | Class | TP | FP | FN | TN | Precision | Recall | F1 score | Accuracy |
|---|---|---|---|---|---|---|---|---|---|---|
Auditorium | TabTransformer | Normal | 11,783 | 230 | 261 | 10,401 | 98.09 | 97.83 | 97.96 | 97.83 |
RATSF | 339 | 0 | 8 | 22,328 | 100 | 97.69 | 98.83 | 99.96 | ||
SATSF | 79 | 0 | 2 | 22,594 | 100 | 97.53 | 98.75 | 99.99 | ||
SFF | 1278 | 261 | 27 | 21,109 | 83.04 | 97.93 | 89.87 | 98.73 | ||
VPF | 60 | 0 | 2 | 22,613 | 100 | 96.77 | 98.36 | 99.99 | ||
CPF | 3775 | 0 | 83 | 18,817 | 100 | 97.85 | 98.91 | 99.63 | ||
HPF | 4870 | 0 | 108 | 17,697 | 100 | 97.83 | 98.9 | 99.52 | ||
Average | 97.3 | 97.63 | 97.37 | 99.38 | ||||||
Overall | 97.83 | |||||||||
TabNet | Normal | 11,806 | 212 | 238 | 10,419 | 98.24 | 98.02 | 98.13 | 98.02 | |
RATSF | 340 | 0 | 7 | 22,328 | 100 | 97.98 | 98.98 | 99.97 | ||
SATSF | 79 | 1 | 2 | 22,593 | 98.75 | 97.53 | 98.14 | 99.99 | ||
SFF | 1278 | 226 | 27 | 21,144 | 84.97 | 97.93 | 90.99 | 98.88 | ||
VPF | 60 | 0 | 2 | 22,613 | 100 | 96.77 | 98.36 | 99.99 | ||
CPF | 3782 | 10 | 76 | 18,807 | 99.74 | 98.03 | 98.88 | 99.62 | ||
HPF | 4880 | 1 | 98 | 17,696 | 99.98 | 98.03 | 99 | 99.56 | ||
Average | 97.38 | 97.76 | 97.5 | 99.43 | ||||||
Overall | 98.02 | |||||||||
Hospital | TabTransformer | Normal | 9900 | 21 | 852 | 2435 | 99.79 | 92.08 | 95.78 | 93.39 |
RATSF | 1627 | 14 | 140 | 11,427 | 99.15 | 92.08 | 95.48 | 98.83 | ||
SATSF | 0 | 714 | 0 | 12,494 | 0 | 0 | 0 | 94.59 | ||
SFF | 354 | 30 | 30 | 12,794 | 92.19 | 92.19 | 92.19 | 99.55 | ||
VPF | 280 | 89 | 25 | 12,814 | 75.88 | 91.8 | 83.09 | 99.14 | ||
CPF | 0 | 98 | 0 | 13,110 | 0 | 0 | 0 | 99.26 | ||
HPF | 0 | 81 | 0 | 13,127 | 0 | 0 | 0 | 99.39 | ||
Average | 91.75 | 92.04 | 91.64 | 97.73 | ||||||
Overall | 92.07 | |||||||||
TabNet | Normal | 9972 | 23 | 780 | 2433 | 99.77 | 92.75 | 96.13 | 93.92 | |
RATSF | 1639 | 13 | 128 | 11,428 | 99.21 | 92.76 | 95.88 | 98.93 | ||
SATSF | 0 | 683 | 0 | 12,525 | 0 | 0 | 0 | 94.83 | ||
SFF | 356 | 28 | 28 | 12,796 | 92.71 | 92.71 | 92.71 | 99.58 | ||
VPF | 282 | 78 | 23 | 12,825 | 78.33 | 92.46 | 84.81 | 99.24 | ||
CPF | 0 | 65 | 0 | 13,143 | 0 | 0 | 0 | 99.51 | ||
HPF | 0 | 69 | 0 | 13,139 | 0 | 0 | 0 | 99.48 | ||
Average | 92.5 | 92.67 | 92.38 | 97.92 | ||||||
Overall | 92.74 | |||||||||
Office | TabTransformer | Normal | 21,807 | 21 | 2007 | 11,182 | 99.9 | 91.57 | 95.56 | 94.21 |
RATSF | 1282 | 4 | 118 | 33,613 | 99.69 | 91.57 | 95.46 | 99.65 | ||
SATSF | 188 | 86 | 18 | 34,725 | 68.61 | 91.26 | 78.33 | 99.7 | ||
SFF | 8788 | 87 | 809 | 25,333 | 99.02 | 91.57 | 95.15 | 97.44 | ||
VPF | 0 | 2274 | 0 | 32,743 | 0 | 0 | 0 | 93.51 | ||
CPF | 0 | 245 | 0 | 34,772 | 0 | 0 | 0 | 99.3 | ||
HPF | 0 | 235 | 0 | 34,782 | 0 | 0 | 0 | 99.33 | ||
Average | 91.8 | 91.49 | 91.12 | 97.75 | ||||||
Overall | 91.57 | |||||||||
TabNet | Normal | 22,054 | 10 | 1760 | 11,193 | 99.95 | 92.61 | 96.14 | 94.95 | |
RATSF | 1297 | 2 | 103 | 33,615 | 99.85 | 92.64 | 96.11 | 99.7 | ||
SATSF | 190 | 69 | 16 | 34,742 | 73.36 | 92.23 | 81.72 | 99.76 | ||
SFF | 8888 | 61 | 709 | 25,359 | 99.32 | 92.61 | 95.85 | 97.8 | ||
VPF | 0 | 2017 | 0 | 33,000 | 0 | 0 | 0 | 94.24 | ||
CPF | 0 | 225 | 0 | 34,792 | 0 | 0 | 0 | 99.36 | ||
HPF | 0 | 204 | 0 | 34,813 | 0 | 0 | 0 | 99.42 | ||
Average | 93.12 | 92.52 | 92.46 | 98.05 | ||||||
Overall | 92.61 |