Table 5 The LLM Policy Instrument Classification Performance.
From: Measuring China’s Policy Stringency on Climate Change for 1954–2022
Policy Instrument Classification | ||||
|---|---|---|---|---|
Prompt_Type | Accuracy | Precision | Recall | F1_Score |
Zero-Shot | 0.938 | 0.937 | 0.938 | 0.938 |
One-Shot | 0.925 | 0.924 | 0.925 | 0.912 |
Few-Shot | 0.925 | 0.917 | 0.925 | 0.917 |
Instruction + One-Shot | 0.944 | 0.941 | 0.944 | 0.940 |
Instruction + Few-Shot | 0.938 | 0.938 | 0.938 | 0.938 |
Instruction + One-Shot + CoT | 0.944 | 0.941 | 0.944 | 0.940 |
Instruction + Few-Shot + CoT | 0.944 | 0.943 | 0.944 | 0.943 |
Instruction + Few-Shot + CoT + Augmentation | 0.956 | 0.951 | 0.956 | 0.950 |