Table 13 Accuracy and AUC for Anti-pattern 1: ensemble Classifiers and Deep-Learning.
| Â | Accuracy | AUC | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
BAG | RF | EXTR | AdaB | GraB | DL1 | DL2 | DL3 | DL4 | BAG | RF | EXTR | AdaB | GraB | DL1 | DL2 | DL3 | DL4 | |
ORG-DATA | ||||||||||||||||||
OD | 90.71 | 91.15 | 92.48 | 90.27 | 91.59 | 92.92 | 92.04 | 92.04 | 92.92 | 0.81 | 0.82 | 0.84 | 0.85 | 0.67 | 0.88 | 0.87 | 0.86 | 0.88 |
SIGF | 89.82 | 89.82 | 91.59 | 91.59 | 90.71 | 91.59 | 92.04 | 92.04 | 92.04 | 0.82 | 0.80 | 0.80 | 0.78 | 0.66 | 0.88 | 0.87 | 0.86 | 0.87 |
AG1 | 91.59 | 92.48 | 91.59 | 92.92 | 92.04 | 90.71 | 90.71 | 90.71 | 90.71 | 0.85 | 0.84 | 0.73 | 0.82 | 0.62 | 0.89 | 0.87 | 0.86 | 0.86 |
AG2 | 90.71 | 89.38 | 89.82 | 88.94 | 89.38 | 90.71 | 90.71 | 90.71 | 90.71 | 0.76 | 0.75 | 0.75 | 0.76 | 0.8 | 0.69 | 0.75 | 0.76 | 0.76 |
AG3 | 90.71 | 90.71 | 91.15 | 89.82 | 91.15 | 90.71 | 90.71 | 90.71 | 90.71 | 0.77 | 0.82 | 0.81 | 0.82 | 0.68 | 0.81 | 0.84 | 0.83 | 0.83 |
AG4 | 90.27 | 89.82 | 91.59 | 89.82 | 91.15 | 89.82 | 90.71 | 90.71 | 90.71 | 0.77 | 0.85 | 0.81 | 0.82 | 0.68 | 0.83 | 0.84 | 0.83 | 0.83 |
AG5 | 90.71 | 88.05 | 89.38 | 89.82 | 90.71 | 90.71 | 90.71 | 90.71 | 90.71 | 0.70 | 0.71 | 0.68 | 0.70 | 0.64 | 0.41 | 0.44 | 0.42 | 0.40 |
AG6 | 90.71 | 88.94 | 86.73 | 89.38 | 89.38 | 90.71 | 90.71 | 90.71 | 90.71 | 0.74 | 0.67 | 0.55 | 0.73 | 0.69 | 0.44 | 0.50 | 0.63 | 0.40 |
AG7 | 91.59 | 91.59 | 92.04 | 90.27 | 89.82 | 92.92 | 89.38 | 90.27 | 90.71 | 0.82 | 0.83 | 0.76 | 0.85 | 0.59 | 0.87 | 0.84 | 0.84 | 0.84 |
AG8 | 90.71 | 90.27 | 91.59 | 91.59 | 91.59 | 92.04 | 90.27 | 90.71 | 90.71 | 0.86 | 0.82 | 0.81 | 0.82 | 0.60 | 0.83 | 0.86 | 0.87 | 0.86 |
AG9 | 90.27 | 89.82 | 91.59 | 91.59 | 89.38 | 90.71 | 90.71 | 90.71 | 90.71 | 0.80 | 0.71 | 0.77 | 0.85 | 0.83 | 0.68 | 0.60 | 0.61 | 0.59 |
AG10 | 90.71 | 91.15 | 90.71 | 91.15 | 87.61 | 90.71 | 90.71 | 90.71 | 90.71 | 0.81 | 0.75 | 0.74 | 0.83 | 0.75 | 0.71 | 0.75 | 0.73 | 0.73 |
AG11 | 88.50 | 91.59 | 90.71 | 90.27 | 90.27 | 90.71 | 90.71 | 90.71 | 90.71 | 0.83 | 0.73 | 0.79 | 0.82 | 0.83 | 0.75 | 0.81 | 0.80 | 0.79 |
AG12 | 91.59 | 90.71 | 90.71 | 90.71 | 88.94 | 90.71 | 90.71 | 90.71 | 90.71 | 0.86 | 0.77 | 0.79 | 0.84 | 0.61 | 0.69 | 0.87 | 0.75 | 0.77 |
AG13 | 89.82 | 91.59 | 92.48 | 89.82 | 90.27 | 90.71 | 90.71 | 90.71 | 90.71 | 0.84 | 0.79 | 0.74 | 0.82 | 0.83 | 0.75 | 0.83 | 0.81 | 0.80 |
INFG | 91.15 | 92.48 | 91.59 | 92.92 | 92.04 | 91.59 | 91.59 | 91.59 | 91.15 | 0.82 | 0.85 | 0.84 | 0.85 | 0.73 | 0.88 | 0.88 | 0.87 | 0.86 |
GNR | 91.59 | 92.04 | 91.15 | 92.92 | 89.38 | 90.71 | 90.71 | 90.71 | 90.71 | 0.91 | 0.88 | 0.83 | 0.87 | 0.52 | 0.85 | 0.80 | 0.89 | 0.88 |
CORR | 90.71 | 92.48 | 93.81 | 92.92 | 88.94 | 91.15 | 90.71 | 90.71 | 90.71 | 0.88 | 0.80 | 0.85 | 0.87 | 0.64 | 0.86 | 0.84 | 0.84 | 0.82 |
CFS | 90.71 | 92.48 | 92.92 | 92.48 | 92.04 | 91.15 | 91.15 | 90.71 | 90.71 | 0.92 | 0.86 | 0.83 | 0.84 | 0.71 | 0.94 | 0.91 | 0.89 | 0.88 |
OneR | 92.04 | 91.59 | 92.04 | 92.92 | 92.92 | 91.15 | 90.71 | 90.71 | 90.71 | 0.9 | 0.85 | 0.83 | 0.79 | 0.64 | 0.79 | 0.84 | 0.86 | 0.83 |
GA | 92.04 | 92.04 | 91.15 | 91.15 | 91.59 | 91.15 | 90.71 | 90.27 | 90.71 | 0.91 | 0.86 | 0.84 | 0.87 | 0.65 | 0.87 | 0.84 | 0.87 | 0.81 |
PCA | 90.71 | 90.27 | 90.27 | 90.27 | 88.94 | 90.71 | 90.71 | 90.71 | 90.71 | 0.82 | 0.81 | 0.78 | 0.75 | 0.75 | 0.47 | 0.53 | 0.52 | 0.44 |
SMOTE-DATA | ||||||||||||||||||
OD | 90.00 | 95.12 | 96.1 | 91.71 | 91.46 | 93.17 | 95.12 | 94.15 | 94.63 | 0.97 | 0.98 | 0.98 | 0.97 | 0.97 | 0.97 | 0.98 | 0.98 | 0.98 |
SIGF | 89.76 | 94.15 | 96.34 | 92.93 | 93.90 | 94.39 | 94.88 | 95.61 | 95.12 | 0.96 | 0.98 | 0.99 | 0.97 | 0.97 | 0.97 | 0.97 | 0.97 | 0.98 |
AG1 | 89.27 | 90.49 | 92.93 | 90.00 | 89.02 | 85.85 | 86.59 | 87.56 | 86.59 | 0.96 | 0.96 | 0.97 | 0.94 | 0.96 | 0.92 | 0.90 | 0.93 | 0.93 |
AG2 | 86.34 | 92.68 | 93.41 | 87.80 | 88.05 | 76.83 | 81.71 | 81.46 | 82.68 | 0.93 | 0.97 | 0.97 | 0.94 | 0.95 | 0.83 | 0.87 | 0.86 | 0.86 |
AG3 | 89.27 | 92.93 | 96.1 | 88.54 | 90.73 | 83.90 | 86.34 | 88.54 | 87.56 | 0.96 | 0.98 | 0.98 | 0.95 | 0.95 | 0.90 | 0.92 | 0.92 | 0.92 |
AG4 | 89.27 | 95.61 | 95.12 | 91.71 | 90.98 | 82.20 | 85.12 | 88.78 | 89.51 | 0.95 | 0.97 | 0.98 | 0.96 | 0.95 | 0.90 | 0.92 | 0.94 | 0.94 |
AG5 | 80.00 | 84.88 | 85.37 | 74.15 | 78.05 | 72.44 | 70.00 | 67.32 | 54.63 | 0.88 | 0.92 | 0.91 | 0.83 | 0.84 | 0.77 | 0.74 | 0.71 | 0.53 |
AG6 | 81.95 | 85.61 | 87.32 | 80.24 | 80.98 | 70.49 | 54.39 | 48.29 | 51.22 | 0.87 | 0.90 | 0.92 | 0.88 | 0.87 | 0.70 | 0.56 | 0.49 | 0.57 |
AG7 | 91.71 | 92.20 | 94.63 | 89.76 | 91.22 | 86.34 | 89.51 | 89.76 | 89.51 | 0.97 | 0.97 | 0.97 | 0.95 | 0.94 | 0.93 | 0.94 | 0.94 | 0.94 |
AG8 | 90.49 | 93.90 | 95.61 | 87.56 | 87.80 | 87.80 | 90.24 | 90.49 | 91.22 | 0.96 | 0.98 | 0.98 | 0.96 | 0.95 | 0.93 | 0.94 | 0.95 | 0.94 |
AG9 | 85.37 | 93.66 | 95.37 | 90.73 | 90.00 | 77.80 | 78.05 | 77.80 | 64.63 | 0.95 | 0.98 | 0.98 | 0.96 | 0.96 | 0.82 | 0.81 | 0.81 | 0.73 |
AG10 | 84.88 | 88.78 | 92.93 | 83.66 | 83.90 | 79.27 | 81.71 | 81.46 | 74.63 | 0.92 | 0.93 | 0.96 | 0.91 | 0.89 | 0.87 | 0.87 | 0.85 | 0.82 |
AG11 | 87.07 | 89.02 | 93.41 | 85.85 | 84.39 | 82.93 | 84.88 | 86.10 | 85.85 | 0.94 | 0.97 | 0.97 | 0.93 | 0.93 | 0.90 | 0.90 | 0.90 | 0.89 |
AG12 | 87.07 | 91.71 | 93.66 | 88.05 | 87.80 | 81.22 | 83.17 | 84.39 | 85.61 | 0.95 | 0.97 | 0.97 | 0.93 | 0.93 | 0.91 | 0.91 | 0.90 | 0.89 |
AG13 | 84.88 | 91.71 | 93.17 | 86.34 | 83.90 | 82.44 | 84.15 | 85.61 | 85.37 | 0.94 | 0.96 | 0.98 | 0.92 | 0.91 | 0.90 | 0.90 | 0.90 | 0.90 |
INFG | 88.29 | 91.71 | 94.15 | 91.46 | 90.73 | 90.00 | 93.17 | 93.17 | 94.39 | 0.96 | 0.97 | 0.97 | 0.97 | 0.96 | 0.96 | 0.97 | 0.97 | 0.96 |
GNR | 88.05 | 88.05 | 90.49 | 85.85 | 86.10 | 86.83 | 87.56 | 88.78 | 81.22 | 0.95 | 0.96 | 0.96 | 0.93 | 0.94 | 0.93 | 0.92 | 0.93 | 0.86 |
CORR | 89.27 | 91.22 | 91.46 | 88.29 | 88.05 | 85.85 | 85.85 | 86.59 | 86.10 | 0.95 | 0.96 | 0.96 | 0.94 | 0.93 | 0.91 | 0.90 | 0.88 | 0.89 |
CFS | 86.34 | 89.51 | 91.46 | 89.76 | 89.02 | 83.90 | 85.12 | 86.10 | 78.54 | 0.93 | 0.95 | 0.96 | 0.93 | 0.94 | 0.91 | 0.90 | 0.91 | 0.88 |
OneR | 89.02 | 89.51 | 92.44 | 90.00 | 90.00 | 86.83 | 87.07 | 78.54 | 78.78 | 0.96 | 0.96 | 0.96 | 0.95 | 0.95 | 0.92 | 0.93 | 0.89 | 0.89 |
GA | 89.76 | 92.44 | 91.46 | 90.49 | 89.27 | 86.83 | 86.59 | 86.34 | 79.76 | 0.95 | 0.96 | 0.96 | 0.94 | 0.94 | 0.92 | 0.93 | 0.92 | 0.90 |
PCA | 88.05 | 91.95 | 91.71 | 85.85 | 86.83 | 75.85 | 74.39 | 64.88 | 56.10 | 0.94 | 0.97 | 0.97 | 0.92 | 0.93 | 0.81 | 0.88 | 0.76 | 0.64 |
SMOTE-DATA | ||||||||||||||||||
BLSMOTE-DATA | ||||||||||||||||||
OD | 89.27 | 94.63 | 96.34 | 93.17 | 91.46 | 92.93 | 93.90 | 93.66 | 95.12 | 0.97 | 0.98 | 0.98 | 0.96 | 0.96 | 0.97 | 0.97 | 0.97 | 0.97 |
SIGF | 89.51 | 92.93 | 95.85 | 91.22 | 90.00 | 92.68 | 92.93 | 93.17 | 93.66 | 0.96 | 0.98 | 0.98 | 0.97 | 0.96 | 0.97 | 0.98 | 0.97 | 0.98 |
AG1 | 91.71 | 93.41 | 94.88 | 91.22 | 92.93 | 88.78 | 89.02 | 91.22 | 90.24 | 0.97 | 0.97 | 0.98 | 0.97 | 0.97 | 0.94 | 0.94 | 0.94 | 0.94 |
AG2 | 90.24 | 95.37 | 96.34 | 93.41 | 94.63 | 85.85 | 88.78 | 90.00 | 92.44 | 0.97 | 0.97 | 0.97 | 0.97 | 0.96 | 0.90 | 0.91 | 0.93 | 0.94 |
AG3 | 91.22 | 94.63 | 96.1 | 92.20 | 92.68 | 87.56 | 89.76 | 90.49 | 91.22 | 0.97 | 0.97 | 0.98 | 0.96 | 0.97 | 0.94 | 0.95 | 0.95 | 0.95 |
AG4 | 91.95 | 93.41 | 96.1 | 93.17 | 93.66 | 88.54 | 90.49 | 90.73 | 91.71 | 0.97 | 0.98 | 0.98 | 0.97 | 0.97 | 0.94 | 0.95 | 0.95 | 0.95 |
AG5 | 79.27 | 85.37 | 84.63 | 73.90 | 80.73 | 73.41 | 69.27 | 70.24 | 48.54 | 0.90 | 0.91 | 0.90 | 0.82 | 0.85 | 0.74 | 0.73 | 0.72 | 0.49 |
AG6 | 82.93 | 86.10 | 87.8 | 80.98 | 78.05 | 72.68 | 60.49 | 63.17 | 54.63 | 0.88 | 0.92 | 0.93 | 0.90 | 0.87 | 0.76 | 0.67 | 0.69 | 0.55 |
AG7 | 89.76 | 91.71 | 94.63 | 88.54 | 88.29 | 88.05 | 89.27 | 89.27 | 90.49 | 0.96 | 0.96 | 0.97 | 0.94 | 0.93 | 0.92 | 0.93 | 0.93 | 0.93 |
AG8 | 89.02 | 93.90 | 95.12 | 88.05 | 88.29 | 85.37 | 87.32 | 87.56 | 87.32 | 0.96 | 0.96 | 0.98 | 0.94 | 0.94 | 0.89 | 0.90 | 0.90 | 0.91 |
AG9 | 87.32 | 95.85 | 95.37 | 91.22 | 92.44 | 83.66 | 83.90 | 76.34 | 76.59 | 0.96 | 0.98 | 0.98 | 0.97 | 0.97 | 0.85 | 0.85 | 0.83 | 0.83 |
AG10 | 87.07 | 91.46 | 92.93 | 88.29 | 85.12 | 81.46 | 84.63 | 85.12 | 78.05 | 0.94 | 0.96 | 0.96 | 0.94 | 0.89 | 0.88 | 0.88 | 0.88 | 0.86 |
AG11 | 88.29 | 92.93 | 94.39 | 86.10 | 86.59 | 84.88 | 87.07 | 88.05 | 87.80 | 0.95 | 0.97 | 0.98 | 0.94 | 0.94 | 0.92 | 0.92 | 0.93 | 0.92 |
AG12 | 89.76 | 92.68 | 92.68 | 89.76 | 90.00 | 83.17 | 86.83 | 87.56 | 87.32 | 0.95 | 0.96 | 0.98 | 0.95 | 0.93 | 0.92 | 0.92 | 0.92 | 0.92 |
AG13 | 87.32 | 90.73 | 93.66 | 85.61 | 86.83 | 81.71 | 83.66 | 84.39 | 77.07 | 0.93 | 0.96 | 0.97 | 0.91 | 0.92 | 0.89 | 0.90 | 0.90 | 0.86 |
INFG | 89.51 | 94.39 | 95.61 | 93.41 | 92.20 | 92.20 | 92.20 | 92.93 | 92.68 | 0.97 | 0.98 | 0.98 | 0.97 | 0.96 | 0.96 | 0.97 | 0.98 | 0.97 |
GNR | 91.71 | 94.63 | 94.63 | 92.20 | 92.68 | 91.95 | 91.95 | 91.71 | 90.73 | 0.97 | 0.98 | 0.98 | 0.96 | 0.96 | 0.95 | 0.95 | 0.94 | 0.93 |
CORR | 89.02 | 92.93 | 93.66 | 92.68 | 91.95 | 86.34 | 86.34 | 86.83 | 85.37 | 0.96 | 0.97 | 0.97 | 0.96 | 0.95 | 0.92 | 0.93 | 0.92 | 0.91 |
CFS | 87.07 | 90.00 | 92.2 | 87.07 | 88.78 | 82.44 | 84.15 | 84.63 | 75.61 | 0.93 | 0.94 | 0.95 | 0.93 | 0.92 | 0.89 | 0.89 | 0.89 | 0.86 |
OneR | 91.95 | 92.20 | 92.68 | 88.05 | 91.71 | 86.10 | 86.10 | 90.00 | 77.32 | 0.97 | 0.96 | 0.97 | 0.95 | 0.96 | 0.93 | 0.94 | 0.95 | 0.87 |
GA | 93.17 | 93.66 | 94.15 | 92.20 | 92.68 | 87.07 | 87.56 | 89.76 | 90.24 | 0.97 | 0.98 | 0.97 | 0.96 | 0.96 | 0.94 | 0.94 | 0.95 | 0.94 |
PCA | 88.05 | 91.71 | 94.39 | 87.80 | 87.07 | 79.51 | 80.98 | 59.02 | 51.22 | 0.94 | 0.97 | 0.97 | 0.93 | 0.94 | 0.88 | 0.90 | 0.69 | 0.52 |