Table 6 Performance evaluation of the proposed MCAM model in three randomized experiments on validation and testing sets. The best-achieved results for all sub-datasets are in bold, whereas the second-best results are underlined. “C” is the class that has “N” and “A,” which represent normal and abnormal labels, whereas GHS represents the complete GasHisSDB dataset. [Values in %].
Set | Exp | Class | Validation | Testing | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
Sens | Spec | F1 | Pre | Acc | Sens | Spec | F1 | Pre | Acc | |||
A | 1st | N | 99.77 | 99.30 | 99.50 | 99.30 | 99.49 | 99.61 | 99.55 | 99.60 | ||
A | 99.30 | 99.77 | 99.61 | 99.50 | 99.61 | 99.61 | 99.49 | 99.56 | 99.40 | 99.55 | ||
2nd | N | 99.75 | 99.73 | 99.51 | 99.30 | 99.65 | 99.58 | 99.70 | 99.62 | |||
A | 99.73 | 99.75 | 99.52 | 99.50 | 99.60 | 99.65 | 99.51 | 99.58 | 99.50 | 99.58 | ||
3rd | N | 99.68 | 99.47 | 99.58 | 99.50 | 99.45 | 99.69 | 99.57 | 99.70 | |||
A | 99.47 | 99.68 | 99.58 | 99.40 | 99.61 | 99.69 | 99.45 | 99.57 | 99.40 | 99.57 | ||
Avg | N | 99.71 | 99.40 | 99.58 | 99.36 | 99.48 | 99.98 | 99.57 | 99.66 | |||
A | 99.40 | 99.71 | 99.56 | 99.46 | 99.94 | 99.98 | 99.48 | 99.57 | 99.43 | 99.57 | ||
B | 1st | N | 99.81 | 99.74 | 99.77 | 99.70 | 99.64 | 99.60 | 99.62 | 99.60 | ||
A | 99.74 | 99.81 | 99.78 | 99.70 | 99.78 | 99.60 | 99.64 | 99.62 | 99.40 | 99.62 | ||
2nd | N | 99.77 | 99.76 | 99.52 | 99.76 | 99.55 | 99.54 | 99.55 | 99.40 | |||
A | 99.76 | 99.77 | 99.51 | 99.69 | 99.77 | 99.54 | 99.55 | 99.55 | 99.30 | 99.55 | ||
3rd | N | 99.75 | 99.78 | 99.77 | 99.78 | 99.72 | 99.67 | 99.69 | 99.70 | |||
A | 99.78 | 99.75 | 99.76 | 99.66 | 99.76 | 99.67 | 99.72 | 99.69 | 99.60 | 99.70 | ||
Avg | N | 99.61 | 99.76 | 99.69 | 99.75 | 99.97 | 99.94 | 99.95 | 99.57 | |||
A | 99.76 | 99.61 | 99.68 | 99.68 | 99.94 | 99.94 | 99.97 | 99.95 | 99.43 | 99.60 | ||
C | 1st | N | 99.09 | 99.53 | 99.32 | 99.50 | 98.42 | 98.76 | 98.59 | 98.80 | ||
A | 99.53 | 99.09 | 99.31 | 99.30 | 99.34 | 99.76 | 99.42 | 99.59 | 97.60 | 98.55 | ||
2nd | N | 98.88 | 99.45 | 99.17 | 99.50 | 98.20 | 98.83 | 98.52 | 98.80 | |||
A | 99.45 | 98.88 | 99.16 | 99.20 | 99.20 | 98.83 | 98.20 | 98.51 | 97.20 | 98.44 | ||
3rd | N | 99.00 | 99.50 | 99.25 | 99.50 | 98.58 | 98.90 | 98.74 | 99.00 | |||
A | 99.50 | 99.00 | 99.25 | 99.20 | 99.28 | 98.90 | 98.58 | 98.74 | 97.80 | 98.70 | ||
Avg | N | 99.08 | 99.13 | 99.25 | 99.50 | 98.40 | 99.16 | 98.62 | 98.86 | |||
A | 99.13 | 99.08 | 99.24 | 99.23 | 99.48 | 99.16 | 98.40 | 98.95 | 97.53 | 98.31 | ||
GHS | 1st | N | 99.18 | 99.13 | 99.16 | 99.10 | 98.75 | 98.45 | 98.60 | 98.40 | ||
A | 99.13 | 99.18 | 99.16 | 99.30 | 99.15 | 98.45 | 98.75 | 98.60 | 97.80 | 98.64 | ||
2nd | N | 99.06 | 99.11 | 99.08 | 99.10 | 98.73 | 98.52 | 98.63 | 98.50 | |||
A | 99.11 | 99.06 | 99.08 | 99.20 | 99.09 | 98.52 | 98.73 | 98.63 | 97.80 | 98.65 | ||
3rd | N | 98.99 | 99.14 | 99.06 | 99.20 | 98.80 | 98.63 | 98.72 | 98.60 | |||
A | 99.14 | 98.99 | 99.06 | 99.00 | 99.07 | 98.63 | 98.80 | 98.71 | 98.00 | 98.74 | ||
Avg | N | 99.08 | 99.13 | 99.10 | 99.13 | 98.76 | 98.53 | 98.72 | 98.50 | |||
A | 99.13 | 99.08 | 99.10 | 99.16 | 99.07 | 98.53 | 98.76 | 98.50 | 97.87 | 98.48 | ||
