Table 1 Performance evaluation of the five prediction models on the validation set. Values in square brackets indicate the 95% Confidence Interval (CI).

From: Construction of a prognostic prediction model for colorectal cancer based on 5-year clinical follow-up data

Metrics

Cox

DT

RF

SVM

XGBoost

Sensitivity [95% CI]

0.57 [0.44, 0.69]

0.57 [0.44, 0.70]

0.67 [0.55, 0.79]

0.58 [0.44, 0.71]

0.75 [0.64, 0.86]

Specificity [95% CI]

0.89 [0.81,0.96]

0.92 [0.85, 0.98]

0.92 [0.85, 0.98]

0.89 [0.81, 0.96]

0.91 [0.83, 0.97]

PPV [95% CI]

0.83 [0.71, 0.93]

0.87 [0.75, 0.97]

0.89 [0.80, 0.98]

0.83 [0.71, 0.94]

0.88 [0.78, 0.96]

NPV [95% CI]

0.69 [0.59, 0.78]

0.69 [0.60, 0.79]

0.75 [0.65, 0.85]

0.70 [0.59, 0.79]

0.80 [0.69, 0.88]

F1 Score [95% CI]

0.67 [0.56, 0.77]

0.69 [0.57, 0.79]

0.76 [0.66, 0.85]

0.69 [0.57, 0.78]

0.81 [0.72, 0.88]

Accuracy [95% CI]

0.73 [0.66, 0.81]

0.75 [0.66, 0.82]

0.80 [0.73, 0.87]

0.74 [0.66, 0.82]

0.83 [0.76, 0.90]

AUC [95% CI]

0.80 [0.73, 0.88]

0.78 [0.70, 0.86]

0.83 [0.74, 0.90]

0.82 [0.75, 0.89]

0.89 [0.82, 0.94]

Brier Score [95% CI]

0.19 [0.15, 0.23]

0.19 [0.14, 0.25]

0.16 [0.11, 0.21]

0.17 [0.13, 0.23]

0.13 [0.09, 0.17]

  1. DT: decision tree; RF: random forest; SVM: support vector machine; XGBoost: extreme gradient boosting; PPV: positive predictive value; NPV: negative predictive value; AUC: area under the receiver operating characteristic curve.