Table 3 Ablation experiment test results.
Type | Entity | Relationship | ||||
|---|---|---|---|---|---|---|
P | R | F1 | P | R | F1 | |
Remove "persona" | 0.759 | 0.733 | 0.746 | 0.732 | 0.726 | 0.729 |
Remove "audience" | 0.763 | 0.746 | 0.756 | 0.762 | 0.752 | 0.749 |
Remove "terminology" | 0.656 | 0.645 | 0.651 | 0.612 | 0.621 | 0.615 |
Remove "instruction" | 0.632 | 0.643 | 0.646 | 0.628 | 0.616 | 0.634 |
Remove " bullet points, labels, and structured forms " | 0.755 | 0.741 | 0.747 | 0.744 | 0.732 | 0.736 |
AI agent | 0.812 | 0.789 | 0.797 | 0.815 | 0.798 | 0.802 |