Table 1 Performance evaluation of the five prediction models on the validation set. Values in square brackets indicate the 95% Confidence Interval (CI).
Metrics | Cox | DT | RF | SVM | XGBoost |
---|---|---|---|---|---|
Sensitivity [95% CI] | 0.57 [0.44, 0.69] | 0.57 [0.44, 0.70] | 0.67 [0.55, 0.79] | 0.58 [0.44, 0.71] | 0.75 [0.64, 0.86] |
Specificity [95% CI] | 0.89 [0.81,0.96] | 0.92 [0.85, 0.98] | 0.92 [0.85, 0.98] | 0.89 [0.81, 0.96] | 0.91 [0.83, 0.97] |
PPV [95% CI] | 0.83 [0.71, 0.93] | 0.87 [0.75, 0.97] | 0.89 [0.80, 0.98] | 0.83 [0.71, 0.94] | 0.88 [0.78, 0.96] |
NPV [95% CI] | 0.69 [0.59, 0.78] | 0.69 [0.60, 0.79] | 0.75 [0.65, 0.85] | 0.70 [0.59, 0.79] | 0.80 [0.69, 0.88] |
F1 Score [95% CI] | 0.67 [0.56, 0.77] | 0.69 [0.57, 0.79] | 0.76 [0.66, 0.85] | 0.69 [0.57, 0.78] | 0.81 [0.72, 0.88] |
Accuracy [95% CI] | 0.73 [0.66, 0.81] | 0.75 [0.66, 0.82] | 0.80 [0.73, 0.87] | 0.74 [0.66, 0.82] | 0.83 [0.76, 0.90] |
AUC [95% CI] | 0.80 [0.73, 0.88] | 0.78 [0.70, 0.86] | 0.83 [0.74, 0.90] | 0.82 [0.75, 0.89] | 0.89 [0.82, 0.94] |
Brier Score [95% CI] | 0.19 [0.15, 0.23] | 0.19 [0.14, 0.25] | 0.16 [0.11, 0.21] | 0.17 [0.13, 0.23] | 0.13 [0.09, 0.17] |