Table 5 Performance comparison in holdout test set.

Week	Model	F1-Score		Recall		Accuracy	AUC
Week	Model	Approved	Reproved	Approved	Reproved	Accuracy	AUC
1	Old	0.56	0.28	0.63	0.24	0.46	0.44
1	New	0.55	0.25	0.53	0.27	0.44	0.40
3	Old	0.54	0.42	0.54	0.42	0.49	0.48
3	New	0.55	0.50	0.46	0.64	0.53	0.56
5	Old	0.65	0.25	0.83	0.18	0.52	0.40
5	New	0.65	0.40	0.59	0.47	0.56	0.55
7	Old	0.62	0.32	0.70	0.27	0.51	0.50
7	New	0.74	0.27	0.69	0.18	0.61	0.46
9	Old	0.72	0.28	0.95	0.17	0.59	0.61
9	New	0.66	0.43	0.76	0.35	0.57	0.56
11	Old	0.71	0.33	0.85	0.24	0.60	0.63
11	New	0.65	0.35	0.73	0.29	0.55	0.50
13	Old	0.79	0.16	0.98	0.09	0.66	0.61
13	New	0.74	0.36	0.81	0.29	0.63	0.54
15	Old	0.77	0.12	0.97	0.06	0.63	0.60
15	New	0.76	0.34	0.89	0.24	0.65	0.52

New models have a different model for each week (old approach). Significant values are in bold.

Quick links

Search