Table 5 The LLM Policy Instrument Classification Performance.

From: Measuring China’s Policy Stringency on Climate Change for 1954–2022

Policy Instrument Classification

Prompt_Type

Accuracy

Precision

Recall

F1_Score

Zero-Shot

0.938

0.937

0.938

0.938

One-Shot

0.925

0.924

0.925

0.912

Few-Shot

0.925

0.917

0.925

0.917

Instruction + One-Shot

0.944

0.941

0.944

0.940

Instruction + Few-Shot

0.938

0.938

0.938

0.938

Instruction + One-Shot + CoT

0.944

0.941

0.944

0.940

Instruction + Few-Shot + CoT

0.944

0.943

0.944

0.943

Instruction + Few-Shot + CoT + Augmentation

0.956

0.951

0.956

0.950

  1. Note: For policy instrument classification, weighted-averaged metrics were applied.