Table 6 The performance criteria of text classification models for each field.

From: A cross-institutional database of operational risk external loss events in Chinese banking sector 1986–2023

Method	Accuracy		Macro-P		Macro-R		Macro-F1		Weighted-P		Weighted-R		Weighted-F1
Method	Mean	Std	Mean	Std	Mean	Std	Mean	Std	Mean	Std	Mean	Std	Mean	Std
Causal factor
KNN	0.730	0.047	0.696	0.260	0.536	0.064	0.542	0.090	0.721	0.082	0.730	0.047	0.703	0.052
LR	0.746	0.032	0.574	0.260	0.515	0.023	0.505	0.025	0.707	0.063	0.746	0.032	0.705	0.032
MNB	0.747	0.031	0.532	0.129	0.522	0.028	0.509	0.032	0.694	0.039	0.747	0.031	0.710	0.032
RF	0.768	0.033	0.634	0.050	0.574	0.034	0.571	0.032	0.743	0.035	0.768	0.033	0.746	0.035
SVM	0.778	0.019	0.664	0.255	0.556	0.022	0.550	0.038	0.749	0.061	0.777	0.019	0.743	0.020
MLP	0.784	0.025	0.723	0.217	0.577	0.033	0.580	0.054	0.768	0.058	0.784	0.025	0.756	0.029
Event type
KNN	0.713	0.046	0.722	0.062	0.494	0.077	0.533	0.088	0.710	0.049	0.713	0.046	0.687	0.049
LR	0.732	0.033	0.621	0.028	0.451	0.072	0.465	0.088	0.694	0.036	0.732	0.033	0.687	0.039
MNB	0.747	0.051	0.686	0.234	0.492	0.090	0.515	0.105	0.722	0.097	0.747	0.051	0.710	0.059
RF	0.755	0.037	0.733	0.064	0.553	0.050	0.591	0.044	0.755	0.038	0.755	0.037	0.740	0.037
SVM	0.755	0.028	0.727	0.242	0.482	0.059	0.501	0.071	0.740	0.072	0.755	0.028	0.716	0.029
MLP	0.766	0.034	0.764	0.163	0.519	0.063	0.547	0.058	0.762	0.046	0.766	0.034	0.734	0.038
Business line
KNN	0.724	0.024	0.673	0.201	0.517	0.036	0.549	0.063	0.716	0.049	0.724	0.024	0.698	0.022
LR	0.674	0.012	0.640	0.050	0.407	0.023	0.446	0.037	0.702	0.033	0.674	0.012	0.622	0.017
MNB	0.707	0.018	0.637	0.023	0.454	0.032	0.492	0.039	0.710	0.023	0.707	0.018	0.667	0.023
RF	0.708	0.033	0.626	0.102	0.527	0.040	0.552	0.044	0.691	0.022	0.708	0.033	0.688	0.031
SVM	0.717	0.014	0.624	0.058	0.479	0.028	0.516	0.035	0.711	0.038	0.717	0.014	0.682	0.016
MLP	0.728	0.051	0.678	0.208	0.501	0.069	0.531	0.071	0.725	0.053	0.728	0.051	0.698	0.056

Notes. The maximum value of each criterion is bolded.

Back to article page

Table 6 The performance criteria of text classification models for each field.

Search

Quick links