Table 3 Evaluation metrics for machine learning modeling of PROs using objective features.

From: Objective wearable measures correlate with self-reported chronic pain levels in people with spinal cord stimulation systems

PRO

Accuracy (mean ± SD)

F1 Score (mean ± SD)

Sensitivity (mean ± SD)

Specificity (mean ± SD)

Precision (mean ± SD)

AUC – ROC (mean ± SD)

NRS

0.768 ± 0.012

0.768 ± 0.012

0.737 ± 0.016

0.869 ± 0.007

0.775 ± 0.021

0.889 ± 0.032

PGIC

0.827 ± 0.063

0.821 ± 0.058

0.657 ± 0.094

0.904 ± 0.059

0.709 ± 0.169

0.873 ± 0.081

PCS

0.837 ± 0.025

0.796 ± 0.048

0.600 ± 0.284

0.935 ± 0.057

0.744 ± 0.158

0.893 ± 0.076

PHQ-9

0.852 ± 0.030

0.835 ± 0.037

0.620 ± 0.198

0.913 ± 0.045

0.703 ± 0.121

0.864 ± 0.061

ODI

0.697 ± 0.042

0.657 ± 0.045

0.667 ± 0.053

0.852 ± 0.029

0.701 ± 0.075

0.862 ± 0.064

PR-29 - Physical Function

0.884 ± 0.001

0.830 ± 0.001

0.978 ± 0.029

0.533 ± 0.339

0.942 ± 0.041

0.784 ± 0.173

PR-29 - Social Roles

0.817 ± 0.035

0.812 ± 0.038

0.664 ± 0.110

0.896 ± 0.057

0.796 ± 0.082

0.883 ± 0.014

PR-29 - Depression

0.887 ± 0.054

0.884 ± 0.053

0.687 ± 0.115

0.893 ± 0.047

0.646 ± 0.0966

0.888 ± 0.027

PR-29 - Anxiety

0.843 ± 0.045

0.839 ± 0.046

0.766 ± 0.110

0.888 ± 0.037

0.755 ± 0.067

0.915 ± 0.032

PR-29 - Fatigue

0.864 ± 0.067

0.850 ± 0.076

0.678 ± 0.078

0.920 ± 0.058

0.746 ± 0.142

0.889 ± 0.041

PR-29 - Sleep Disturbance

0.948 ± 0.001

0.923 ± 0.001

0.350 ± 0.390

0.970 ± 0.032

0.437 ± 0.390

0.877 ± 0.102

PR-29 - Pain Interference

0.846 ± 0.061

0.845 ± 0.061

0.833 ± 0.095

0.816 ± 0.078

0.844 ± 0. 0.058

0.917 ± 0.032

  1. AUC-ROC area under the receiver operating characteristic (ROC) curve, NRS numerical rating scale, PR-29 patient-reported outcomes measurement information system 29, PCS pain catastrophizing scale, PHQ-9 patient health questionnaire-9, ODI Oswestry disability index, PGIC patient global impression of change, SD standard deviation.