Table 10 Agreement (F1-score) between pre- and final annotations.

From: PGxCorpus, a manually annotated corpus for pharmacogenomics

Entity matching:

Exact

Exact

Partial

Partial

Type matching:

same type

potentially different

same type

potentially different

F1-Score (P;R)

54.2 (66.9;45.5)

59.0 (72.9;49.6)

64.4 (79.6;54.1)

76.2 (94.1;64.0)

  1. This agreement evaluates the amount of manual corrections that was required after the automatic pre-annotation phase. Precision (P) and recall (R) are given between parenthesis.