Table 8 Comparison results of best model on test set.
From: Fault-class coverage–aligned combined training for AFDD of AHUs across multiple buildings
Category | Normal | RTASF | SATSF | SFF | VPF | CPF | HPF | Average | Overall |
|---|---|---|---|---|---|---|---|---|---|
TabNet with unified data (Auditorium) | |||||||||
F1 score | 98.09 | 98.83 | 98.14 | 90.80 | 98.36 | 98.82 | 98.95 | 97.43 | – |
Accuracy | 97.97 | 99.96 | 99.99 | 98.86 | 99.99 | 99.60 | 99.55 | 99.42 | 97.91 |
TabNet with unified data (Hospital) | |||||||||
F1 score | 96.04 | 95.72 | – | 92.15 | 84.11 | – | – | 92.01 | – |
Accuracy | 93.78 | 98.89 | 94.83 | 99.55 | 99.21 | 99.51 | 99.48 | 97.89 | 92.5 |
TabNet with unified data (Office) | |||||||||
F1 score | 96.07 | 95.96 | 81.21 | 95.76 | – | – | – | 92.25 | – |
Accuracy | 94.86 | 99.69 | 99.75 | 97.76 | 94.24 | 99.36 | 99.42 | 97.87 | 92.46 |
TabNet with single data (Auditorium) | |||||||||
F1 score | 97.34 | 98.12 | 97.96 | 90.13 | 97.77 | 98.13 | 98.31 | 96.82 | – |
Accuracy | 96.83 | 99.53 | 99.93 | 98.25 | 98.31 | 99.37 | 98.92 | 98.73 | 97.37 |
TabNet with single data (Hospital) | |||||||||
F1 score | 97.28 | 95.90 | – | 94.40 | 94.02 | – | – | 95.40 | – |
Accuracy | 93.96 | 98.95 | 94.90 | 99.58 | 99.27 | 99.53 | 99.49 | 97.95 | 97.21 |
TabNet with single data (Office) | |||||||||
F1 score | 97.18 | 96.05 | 95.95 | 95.90 | – | – | – | 96.27 | – |
Accuracy | 94.95 | 99.72 | 99.78 | 97.84 | 94.28 | 99.40 | 99.44 | 97.92 | 97.29 |
ANN with single data (Auditorium) | |||||||||
F1 score | 97.22 | 98.03 | 97.73 | 89.98 | 97.74 | 98.16 | 98.29 | 96.74 | – |
Accuracy | 96.77 | 99.50 | 99.88 | 98.21 | 98.29 | 99.35 | 98.89 | 98.70 | 97.51 |
ANN with single data (Hospital) | |||||||||
F1 score | 95.99 | 95.63 | - | 92.02 | 93.90 | – | – | 94.39 | – |
Accuracy | 93.71 | 98.84 | 94.79 | 99.51 | 99.19 | 99.49 | 99.46 | 97.86 | 97.33 |
ANN with single data (Office) | |||||||||
F1 score | 95.98 | 95.91 | 91.02 | 95.62 | – | – | – | 94.63 | – |
Accuracy | 94.90 | 99.67 | 99.71 | 97.63 | 94.16 | 99.33 | 99.39 | 97.83 | 97.16 |
RNN-LSTM with single data (Auditorium) | |||||||||
F1 score | 97.31 | 98.10 | 97.82 | 90.09 | 97.81 | 98.24 | 98.36 | 96.82 | – |
Accuracy | 96.79 | 99.52 | 99.90 | 98.23 | 98.31 | 99.37 | 98.91 | 98.72 | 97.52 |
RNN-LSTM with single data (Hospital) | |||||||||
F1 score | 96.03 | 95.66 | – | 92.07 | 94.12 | – | – | 94.47 | – |
Accuracy | 93.75 | 98.86 | 94.81 | 99.52 | 99.20 | 99.51 | 99.47 | 97.87 | 97.19 |
RNN-LSTM with single data (Office) | |||||||||
F1 score | 96.02 | 95.95 | 91.36 | 95.75 | – | – | – | 94.77 | – |
Accuracy | 94.94 | 99.68 | 99.74 | 97.76 | 94.22 | 99.35 | 99.41 | 97.87 | 97.22 |
GCN with single data (Auditorium) | |||||||||
F1 score | 97.06 | 97.32 | 97.54 | 91.73 | 97.78 | 97.99 | 98.77 | 96.88 | – |
Accuracy | 95.43 | 99.37 | 99.54 | 98.22 | 98.36 | 99.41 | 98.52 | 98.41 | 97.53 |
GCN with single data (Hospital) | |||||||||
F1 score | 95.62 | 95.61 | – | 91.58 | 93.16 | – | – | 93.99 | – |
Accuracy | 93.61 | 98.72 | 94.75 | 99.14 | 99.31 | 99.12 | 99.62 | 97.75 | 97.81 |
GCN with single data (Office) | |||||||||
F1 score | 95.73 | 95.41 | 90.76 | 95.21 | – | – | – | 94.28 | – |
Accuracy | 95.59 | 99.68 | 99.66 | 98.42 | 94.28 | 99.22 | 99.17 | 98.00 | 97.67 |
