Table 8 Evaluation Index of Each Model in JNU.
Evaluation Index | Model | Fault Type | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
IRF1 | IRF2 | IRF3 | ORF1 | ORF2 | ORF3 | REF1 | REF2 | REF3 | ||
F1-score | SVM | 0.7541 | 0.8966 | 0.7302 | 0.8400 | 0.9474 | 0.8889 | 0.8788 | 0.9153 | 0.8519 |
SDAE-SVM | 0.7556 | 0.9351 | 0.7692 | 0.9153 | 0.9804 | 0.9375 | 0.7869 | 0.9355 | 0.8116 | |
KELM | 0.4000 | 0.6133 | 0.3810 | 0.5600 | 0.6885 | 0.5000 | 0.3462 | 0.5783 | 0.4691 | |
SDAE-KELM | 0.5882 | 0.7308 | 0.6824 | 0.4789 | 0.6885 | 0.5301 | 0.7451 | 0.5630 | 0.5487 | |
HHKELM | 0.6429 | 0.8611 | 0.6667 | 0.8148 | 0.8750 | 0.8615 | 0.8400 | 0.8214 | 0.7667 | |
SDAE-HHKELM | 0.8846 | 0.7619 | 0.9333 | 0.8519 | 0.9552 | 0.8529 | 0.8966 | 0.9355 | 0.9032 | |
IAO-HHKELM | 0.9091 | 0.9211 | 0.8615 | 0.9630 | 0.9394 | 0.9538 | 0.8000 | 0.9200 | 0.8475 | |
SDAE-AHHKELM | 1.0000 | 0.9412 | 0.9867 | 0.9811 | 0.9552 | 0.9859 | 0.9667 | 1.0000 | 0.9677 | |
Precision | SVM | 0.8214 | 0.9286 | 0.6571 | 0.8750 | 0.9000 | 0.8889 | 0.9355 | 0.9000 | 0.8214 |
SDAE-SVM | 0.6800 | 0.9231 | 0.8696 | 0.9000 | 0.9615 | 0.9677 | 0.7273 | 0.9667 | 0.8485 | |
KELM | 0.4000 | 0.6053 | 0.2759 | 0.4828 | 0.8400 | 0.4242 | 0.3214 | 0.7500 | 0.5278 | |
SDAE-KELM | 0.4464 | 0.7308 | 0.6170 | 0.3400 | 0.8077 | 0.4000 | 0.7451 | 0.7917 | 0.7949 | |
HHKELM | 0.6429 | 0.8857 | 0.6364 | 0.7857 | 0.8000 | 0.8750 | 0.8750 | 0.8846 | 0.7931 | |
SDAE-HHKELM | 0.8519 | 1.0000 | 0.9211 | 0.8846 | 0.9412 | 0.8056 | 0.8387 | 0.9062 | 0.9333 | |
IAO-HHKELM | 0.8929 | 1.0000 | 0.8485 | 0.9286 | 0.8857 | 0.9688 | 0.8333 | 0.8846 | 0.8621 | |
SDAE-AHHKELM | 1.0000 | 1.0000 | 0.9737 | 1.0000 | 0.9412 | 0.9722 | 0.9355 | 1.0000 | 1.0000 | |
Recall | SVM | 0.6970 | 0.8667 | 0.8214 | 0.8077 | 1.0000 | 0.8889 | 0.8286 | 0.9310 | 0.8840 |
SDAE-SVM | 0.8500 | 0.9474 | 0.6897 | 0.9310 | 1.0000 | 0.9091 | 0.8571 | 0.9062 | 0.7778 | |
KELM | 0.4000 | 0.6216 | 0.6154 | 0.6667 | 0.5833 | 0.6087 | 0.3750 | 0.4706 | 0.4222 | |
SDAE-KELM | 0.8621 | 0.7308 | 0.7632 | 0.8095 | 0.6000 | 0.7857 | 0.7451 | 0.4368 | 0.4189 | |
HHKELM | 0.6429 | 0.8378 | 0.7000 | 0.8462 | 0.9655 | 0.8485 | 0.8077 | 0.7667 | 0.7419 | |
SDAE-HHKELM | 0.9200 | 0.6154 | 0.9459 | 0.8214 | 0.9697 | 0.9062 | 0.9630 | 0.9667 | 0.8750 | |
IAO-HHKELM | 0.9259 | 0.8537 | 0.8750 | 1.0000 | 1.0000 | 0.9394 | 0.7692 | 0.9583 | 0.8333 | |
SDAE-AHHKELM | 1.0000 | 0.8889 | 1.0000 | 0.9630 | 0.9697 | 1.0000 | 1.0000 | 1.0000 | 0.9375 | |