Table 10 Comparison between dictionary mapping and manual verification of binding force results.
Binding force | Dictionary Mapping vs. Manual check | ||
|---|---|---|---|
Precision | Recall | F1 | |
Constitution | 1.00 | 1.00 | 1.00 |
International Law | 1.00 | 1.00 | 1.00 |
Law/Act | 0.94 | 1.00 | 0.97 |
Decree/Order/Ordinance | 0.94 | 1.00 | 0.97 |
Regulation/Directive/Decision | 0.95 | 0.99 | 0.97 |
Preparatory Instruments | 0.96 | 0.99 | 0.97 |
Informative Instruments | 0.80 | 0.94 | 0.86 |
Interpretative Communications and Notices | 0.87 | 0.72 | 0.79 |
Decisional Guidelines, Codes and Frameworks | 0.97 | 0.96 | 0.97 |
Decisional Notices and Communications | 0.75 | 0.74 | 0.75 |
Steering Instruments | 0.97 | 0.91 | 0.94 |
Other Strategy Plan or Target | 1.00 | 0.62 | 0.76 |
Macro Average | 0.93 | 0.91 | 0.91 |
