Table 5 Ranking of ML models based on statistical performance metrics using the 5-fold cross-validation method.
Fold no. | SVR | GPR | NuSVR | MLPR | ANN | VR | HGBR | ETR | RF | GBR | XGBoost | DTR | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Fold 1 | R2 | 0.9518 | 0.9312 | 0.9344 | 0.9087 | 0.8862 | 0.8123 | 0.7983 | 0.7931 | 0.7562 | 0.7503 | 0.7288 | 0.3312 |
Score | 12 | 11 | 10 | 9 | 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
RMSE | 2.98 | 3.82 | 3.99 | 5.13 | 5.87 | 7.21 | 7.66 | 8.03 | 8.57 | 8.94 | 9.25 | 13.81 | |
Score | 12 | 11 | 10 | 9 | 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
VAF (%) | 97.2 | 96.14 | 95.83 | 94.12 | 94.01 | 88.86 | 88.04 | 87.43 | 87.12 | 86.39 | 85.74 | 58.31 | |
Score | 12 | 11 | 10 | 9 | 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
Fold 2 | R2 | 0.9716 | 0.9594 | 0.9643 | 0.95 | 0.9349 | 0.8744 | 0.8649 | 0.8634 | 0.8319 | 0.8297 | 0.8113 | 0.4593 |
Score | 12 | 10 | 11 | 9 | 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
RMSE | 2.88 | 3.72 | 3.89 | 5.04 | 5.78 | 7.12 | 7.57 | 7.94 | 8.48 | 8.85 | 9.16 | 13.75 | |
Score | 12 | 11 | 10 | 9 | 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
VAF (%) | 98.69 | 98.05 | 97.83 | 96.69 | 96.95 | 92.47 | 91.87 | 91.45 | 91.41 | 90.86 | 90.37 | 65.22 | |
Score | 12 | 11 | 10 | 8 | 9 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
Fold 3 | R2 | 0.9905 | 0.9825 | 0.9883 | 0.9797 | 0.9683 | 0.9146 | 0.9073 | 0.9077 | 0.8789 | 0.8785 | 0.8617 | 0.5328 |
Score | 12 | 10 | 11 | 9 | 8 | 7 | 5 | 6 | 4 | 3 | 2 | 1 | |
RMSE | 2.43 | 3.97 | 3.48 | 5.72 | 6.83 | 8.95 | 9.64 | 10.21 | 11.03 | 11.60 | 12.07 | 19.49 | |
Score | 12 | 11 | 10 | 9 | 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
VAF (%) | 98.52 | 97.84 | 97.61 | 96.41 | 96.63 | 92.09 | 91.47 | 91.03 | 90.96 | 90.40 | 89.89 | 64.51 | |
Score | 12 | 11 | 10 | 8 | 9 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
Fold 4 | R2 | 0.9713 | 0.9671 | 0.9623 | 0.9461 | 0.9298 | 0.8671 | 0.8568 | 0.8547 | 0.8223 | 0.8195 | 0.8006 | 0.4411 |
Score | 12 | 11 | 10 | 9 | 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
RMSE | 2.76 | 3.21 | 3.79 | 5.29 | 6.16 | 7.76 | 8.29 | 8.73 | 9.36 | 9.80 | 10.16 | 15.68 | |
Score | 12 | 11 | 10 | 9 | 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
VAF (%) | 98.14 | 97.34 | 97.09 | 95.74 | 95.86 | 91.14 | 90.46 | 89.97 | 89.83 | 89.22 | 88.66 | 62.68 | |
Score | 12 | 11 | 10 | 8 | 9 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
Fold 5 | R2 | 0.9590 | 0.9370 | 0.9439 | 0.9156 | 0.8931 | 0.8187 | 0.8046 | 0.7993 | 0.7624 | 0.7564 | 0.7349 | 0.3345 |
Score | 12 | 10 | 11 | 9 | 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
RMSE | 2.75 | 3.70 | 3.79 | 5.43 | 6.34 | 8.04 | 8.61 | 9.07 | 9.74 | 10.20 | 10.59 | 16.47 | |
Score | 12 | 11 | 10 | 9 | 8 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
VAF (%) | 98.34 | 97.67 | 97.38 | 96.21 | 96.43 | 91.88 | 91.26 | 90.82 | 90.75 | 90.18 | 89.67 | 64.30 | |
Score | 12 | 11 | 10 | 8 | 9 | 7 | 6 | 5 | 4 | 3 | 2 | 1 | |
All folds | Sum of scores | 180 | 162 | 153 | 131 | 124 | 105 | 89 | 76 | 60 | 45 | 30 | 15 |