Table 5 Test set comparison experiment

From: Visual information identification and Q&A of intangible cultural heritage inheritors by using enhanced Graph-Retrieval framework

Category			VisualWordGrid	BROS	GC-few shot	Improved-GNN	Donut	M-weighted graph	DocExtractNet	Graph-Retrieval
Item	P	0.811	0.822	0.827	0.853	0.863	0.882	0.902	0.913	0.932
	R	0.816	0.806	0.814	0.853	0.872	0.885	0.902	0.911	0.931
	F	0.814	0.814	0.820	0.853	0.868	0.884	0.902	0.912	0.931
Item-name	P	0.789	0.801	0.817	0.847	0.855	0.874	0.894	0.909	0.929
	R	0.774	0.821	0.818	0.848	0.847	0.871	0.894	0.907	0.929
	F	0.781	0.811	0.817	0.847	0.851	0.873	0.894	0.908	0.929
Area	P	0.825	0.822	0.837	0.859	0.863	0.866	0.891	0.905	0.925
	R	0.833	0.823	0.828	0.859	0.866	0.867	0.891	0.906	0.926
	F	0.829	0.823	0.832	0.859	0.865	0.866	0.891	0.906	0.925
Name	P	0.799	0.817	0.803	0.851	0.844	0.852	0.876	0.903	0.929
	R	0.786	0.822	0.823	0.851	0.840	0.854	0.876	0.904	0.928
	F	0.792	0.819	0.813	0.851	0.842	0.853	0.876	0.903	0.929
Gender	P	0.838	0.837	0.848	0.857	0.874	0.891	0.906	0.913	0.933
	R	0.841	0.853	0.841	0.856	0.875	0.887	0.905	0.914	0.932
	F	0.839	0.845	0.844	0.857	0.874	0.889	0.905	0.913	0.932
Career	P	0.822	0.834	0.836	0.853	0.853	0.867	0.895	0.907	0.929
	R	0.815	0.830	0.827	0.854	0.861	0.869	0.896	0.906	0.929
	F	0.819	0.832	0.832	0.853	0.857	0.868	0.895	0.906	0.929
Birthday	P	0.844	0.854	0.862	0.857	0.885	0.898	0.908	0.909	0.932
	R	0.839	0.849	0.860	0.856	0.881	0.896	0.909	0.910	0.932
	F	0.842	0.852	0.861	0.857	0.883	0.897	0.909	0.910	0.932
Work unit	P	0.802	0.812	0.833	0.845	0.866	0.883	0.896	0.899	0.926
	R	0.793	0.825	0.825	0.845	0.873	0.885	0.895	0.900	0.925
	F	0.797	0.818	0.829	0.845	0.869	0.884	0.896	0.899	0.925
Application unit	P	0.774	0.786	0.792	0.842	0.833	0.852	0.884	0.899	0.921
	R	0.792	0.779	0.807	0.842	0.829	0.850	0.884	0.901	0.922
	F	0.783	0.783	0.799	0.842	0.831	0.851	0.884	0.900	0.922
Description	P	0.814	0.827	0.814	0.851	0.844	0.863	0.877	0.913	0.927
	R	0.824	0.837	0.823	0.849	0.841	0.866	0.877	0.911	0.927
	F	0.819	0.832	0.818	0.850	0.842	0.865	0.877	0.912	0.927
Macro avg	P	0.812	0.821	0.827	0.851	0.858	0.873	0.893	0.907	0.928
	R	0.811	0.824	0.826	0.851	0.858	0.873	0.893	0.907	0.928
	F	0.812	0.823	0.826	0.851	0.858	0.873	0.893	0.907	0.928
Weighted avg	P	0.803	0.815	0.826	0.857	0.863	0.879	0.899	0.916	0.931
	R	0.822	0.828	0.836	0.858	0.866	0.876	0.901	0.915	0.932
	F	0.812	0.821	0.831	0.858	0.864	0.876	0.900	0.916	0.932

Back to article page

Table 5 Test set comparison experiment

Search

Quick links