Table 3 Relapse prediction framework performance on unseen test data with provider burden, and patient burden.

From: Personalized relapse prediction in patients with major depressive disorder using digital biomarkers

Dataset

Prediction performance

Framework

SEN (%)

SPEC (%)

BAC (%)

PPV (%)

NPV (%)

FPR (%)

FAR (%, per patient-year)

OBSERVEMDD

Active

76

68

72

9

98.6

32

31, 2.35

Passive + Active

66

81

73.5

12.5

98.3

19

18.5, 1.8

CBN-WELL

Active

90

60

75

13.2

98.9

40

37.8, 3

Passive + Active

70

72

71

14.6

97.2

28

26.2, 2.3

Dataset

Provider burden

Framework

Total number of patient days of observation (N)

Total number of preemptive visits (N)

Provider burden (per patient-year)

OBSERVEMDD

Active

59,606

422

2.58

Passive + Active

47,378

265

2.04

CBN-WELL

Active

7196

68

3.45

Passive + Active

6487

48

2.7

Dataset

Patient burden

Framework

Total number of self-report assessments required (N, %)

OBSERVEMDD

Active

8515, 100

Passive + Active

3240, 38.1

CBN-WELL

Active

1028, 100

Passive + Active

484, 47

  1. BAC, balanced accuracy; FAR, false alarm rate; NPV, negative predictive value; PPV, positive predictive value; SEN, sensitivity; SPEC, specificity.
  2. Provider burden was estimated based on the total number of preemptive visits (True Positive + False Positives) to the total number of patient days of observation; for instance, 2.58 relapse alarm/patient/year is obtained by 422/59,606. Patient burden was estimated based on the total number of self-report assessments required to be completed by the patient.
  3. Since the “Active” framework was based on self-reports collected on a weekly basis, we defined it as the maximal patient burden (100%) and estimated the relative patient burden in “Active + Passive” framework as a fraction of the total self-reports used in that framework.