Table 8 Inter-annotator agreement (F1-score) for entity annotations.
From: PGxCorpus, a manually annotated corpus for pharmacogenomics
Entity matching: (exact or partial) | exact | exact | partial | partial |
|---|---|---|---|---|
Considering hierarchy: (yes or no) | no | yes | no | yes |
Chemical | 76.8 | 76.8 | 82.1 | 82.1 |
Genomic_factor | 38.6 | 72.6 | 38.8 | 85.7 |
↳Gene_or_protein | 85.3 | 85.3 | 90.0 | 89.4 |
↳Genomic_variation | 32.9 | 49.3 | 53.0 | 76.8 |
↳Limited_variation | 50.8 | 50.8 | 69.0 | 66.2 |
↳Haplotype | 76.2 | 76.2 | 77.2 | 76.1 |
Phenotype | 30.5 | 51.0 | 53.9 | 72.6 |
↳Disease | 71.3 | 71.0 | 80.9 | 79.1 |
↳Pharmacokinetic_phenotype | 48.2 | 48.2 | 57.0 | 57.0 |
↳Pharmacodynamic_phenotype | 31.7 | 31.7 | 47.0 | 47.0 |
Macro average | 57.4 | 63.8 | 68.7 | 76.1 |
