Table 6 Average model performance by percentile categories for symptom endorsement, survey adherence, and symptom variability

From: Developing personalized algorithms for sensing mental health symptoms in daily life

	Symptom endorsement
	Average sensitivity				Average specificity				Average macro F1
	<25%	25–50%	50–75%	>75%	<25%	25–50%	50–75%	>75%	<25%	25–50%	50–75%	>75%
Happiness	0.30	0.54	0.65	0.73	0.76	0.74	0.56	0.23	0.51	0.63	0.6	0.46
Sadness	0.17	0.35	0.41	0.56	0.8	0.72	0.72	0.61	0.43	0.51	0.55	0.57
Anxiety	0.33	0.47	0.58	0.6	0.85	0.65	0.71	0.51	0.56	0.54	0.64	0.54
Angry	0	0.36	0.17	0.62	0.98	0.79	0.84	0.48	0.48	0.49	0.51	0.49
Stress	0.13	0.61	0.49	0.66	0.75	0.68	0.71	0.44	0.42	0.64	0.59	0.54
Quality time	0.28	0.57	0.7	0.9	0.71	0.69	0.41	0.19	0.44	0.61	0.54	0.53
Closeness	0.3	0.41	0.6	0.75	0.76	0.74	0.33	0.24	0.52	0.55	0.41	0.45
Positive interactions	0.23	0.48	0.48	0.91	0.77	0.72	0.53	0.3	0.43	0.57	0.48	0.52
Negative interactions	0	0	0.1	0.29	0.99	0.97	0.81	0.79	0.48	0.45	0.43	0.51
Conflict	0	0.07	0.47	0.33	0.93	0.91	0.73	0.84	0.45	0.47	0.58	0.54
Aggression	0	0	0	0	1	1	0.9	1	0.46	0.48	0.43	0.44
Happiness	0.72	0.48	0.53	0.46	0.44	0.62	0.63	0.61	0.57	0.53	0.56	0.51
Sadness	0.33	0.26	0.59	0.29	0.69	0.7	0.62	0.84	0.49	0.46	0.55	0.56
Anxiety	0.31	0.47	0.7	0.52	0.82	0.62	0.63	0.63	0.54	0.52	0.65	0.57
Anger	0.17	0.33	0.39	0.3	0.87	0.9	0.65	0.66	0.46	0.59	0.46	0.47
Stress	0.37	0.48	0.63	0.41	0.68	0.7	0.47	0.74	0.51	0.58	0.54	0.56
Quality time	0.58	0.47	0.57	0.75	0.45	0.47	0.64	0.47	0.49	0.46	0.56	0.59
Closeness	0.52	0.43	0.58	0.55	0.51	0.54	0.58	0.45	0.43	0.48	0.58	0.45
Positive interactions	0.66	0.37	0.51	0.56	0.54	0.64	0.55	0.59	0.53	0.41	0.51	0.55
Negative interactions	0	0.23	0	0.16	1	0.81	0.99	0.76	0.47	0.51	0.46	0.43
Conflict	0	0.17	0.35	0.33	0.93	0.81	0.97	0.75	0.45	0.49	0.64	0.48
Aggression	0	0	0	0	1	1	1	0.9	0.46	0.48	0.44	0.43
Happiness	0.63	0.49	0.54	0.53	0.38	0.56	0.66	0.69	0.48	0.50	0.59	0.59
Sadness	0.33	0.37	0.47	0.31	0.74	0.71	0.68	0.72	0.48	0.53	0.55	0.51
Anxiety	0.44	0.60	0.49	0.45	0.59	0.78	0.74	0.63	0.48	0.67	0.61	0.53
Anger	0.50	0.25	0.28	0.10	0.64	0.72	0.87	0.88	0.52	0.43	0.54	0.48
Stress	0.35	0.54	0.48	0.52	0.50	0.63	0.78	0.66	0.41	0.58	0.62	0.58
Quality time	0.56	0.67	0.53	0.64	0.60	0.38	0.45	0.57	0.52	0.50	0.47	0.60
Closeness	0.39	0.33	0.65	0.69	0.49	0.87	0.31	0.48	0.38	0.58	0.47	0.54
Positive interactions	0.56	0.45	0.45	0.63	0.59	0.56	0.64	0.51	0.49	0.45	0.51	0.56
Negative interactions	0	0.13	0.19	0.03	0.96	0.95	0.77	0.91	0.41	0.52	0.47	0.46
Conflict	0.13	0.10	0.39	0.19	0.90	0.91	0.84	0.77	0.46	0.48	0.61	0.47
Aggression	0	0	0	0	1	1	1	0.9	0.46	0.44	0.48	0.43

Average sensitivity, specificity, and macro F1 score based on symptom endorsement, survey adherence, and symptom variability. We defined four levels for each group lying below the 25% quantile, within the 25–50% quantile, within the 50–75% quantile, and above the 75% quantile. The highest sensitivity, specificity, and macro F1 score values for the specific level of % of positive samples are colored blue.

Back to article page

Table 6 Average model performance by percentile categories for symptom endorsement, survey adherence, and symptom variability

Search

Quick links