Table 3 The NER results of the Tiny scale models were evaluated on four entities excluding normal entities.

Type		Tiny BERT	Tiny scratch v1	Tiny scratch v2	Tiny continual v1	Tiny continual v2	TIny BioBert
B-BP(1)	P	0.756	0.871	0.882	0.892	0.875	0.847
	R	0.595	0.642	0.639	0.635	0.642	0.612
	F	0.666	0.739	0.741	0.742	0.741	0.711
I-BP(2)	P	0.752	0.845	0.843	0.864	0.851	0.785
	R	0.774	0.775	0.788	0.804	0.778	0.747
	F	0.763	0.809	0.815	0.833	0.813	0.766
B-DN(3)	P	0.805	0.905	0.901	0.867	0.932	0.818
	R	0.416	0.770	0.698	0.586	0.767	0.463
	F	0.548	0.832	0.787	0.699	0.783	0.591
I-DN(4)	P	0.889	1.00	1.00	0.913	0.826	0.778
	R	0.291	0.286	0.411	0.375	0.339	0.255
	F	0.438	0.444	0.582	0.532	0.481	0.384
B-DN(5)	P	0.662	0.808	0.812	0.817	0.786	0.762
	R	0.615	0.888	0.879	0.857	0.871	0.771
	F	0.638	0.846	0.844	0.837	0.826	0.767
I-DN(6)	P	0.709	0.717	0.680	0.711	0.730	0.784
	R	0.700	0.747	0.754	0.765	0.749	0.739
	F	0.704	0.731	0.715	0.737	0.739	0.761
B-MP(7)	P	0.669	0.788	0.768	0.764	0.734	0.775
	R	0.363	0.578	0.494	0.481	0.472	0.491
	F	0.470	0.667	0.601	0.590	0.575	0.601
I-MP(8)	P	0.762	0.750	0.719	0.634	0.659	0.680
	R	0.604	0.500	0.426	0.481	0.537	0.618
	F	0.674	0.600	0.535	0.547	0.592	0.648

In the table, the types correspond to BP, body part; DR, drug name; DN, disease name and MP, medical procedure.
Significant values are in [bold].

Quick links

Search