Table 4 Ablation study results.

From: Knowledge enhancement and full utilization of document information for document-level biomedical relation extraction

 

Model

CDR F1(%)

GDA F1(%)

Overall

Intra-

Inter-

Overall

Intra-

Inter-

w/o FDI

KnowFDI (full model)

86.8

89.8

79.5

84.8

87.2

69.6

w/o local context

85.4

88.8

77.0

83.2

86.3

63.3

w/o global context

86.2

90.4

76.5

83.9

87.6

59.8

w/o context

83.2

86.9

74.1

83.9

87.3

62.7

w/o structure

86.2

89.2

79.3

84.2

87.3

64.9

w/o all

77.8

82.5

66.1

76.3

81.1

47.8

w/o knowledge

84.8

88.9

74.9

83.1

86.9

59.8

KnowFDI (Single-stage fusion)

84.1

88.3

75.0

82.6

86.0

63.6

KnowFDI (Half knowledge)

84.9

89.2

74.8

85.5

88.5

67.6

  1. All KnowFDI and ablated model results represent stable performance metrics, typically derived from averaging over multiple independent runs. The full model (KnowFDI) uses ‘–use_knowledge True –num_stages 2 –graph_type RGCN –knowledge_keep_ratio 1.0.’