Table 7 Hyperparameters of the three tested LLMs: RL-BNE, BIO-CLI and XRB.
From: A clinical narrative corpus on nut allergy: annotation schema, guidelines and use case
Hyperparameter | RL-BNE | BIO-CLI | XRB |
|---|---|---|---|
Learning rate | 1 × 10−5 | 1 × 10−5 | 1 × 10−5 |
Batch size | 8 | 16 | 16 |
Epoch | 6 | 4 | 4 |
Weight Decay | 0.01 | 0.01 | 0.01 |
Adam beta1 | 0.9 | 0.9 | 0.9 |
Adam beta2 | 0.999 | 0.999 | 0.999 |
Adam epsilon | 1 × 10−8 | 1 × 10−8 | 1 × 10−8 |
Early stopping patience | 2 | 2 | 2 |
