Table 3 Summary statistics for intercoder reliability.

From: A thematic analysis of what Australians state would change their minds on climate change

 

Coder 1 & 2

Coder 1 & GPT

Coder 2 & GPT

Gwet’s AC(1)

95% CI

Percentage agreement

Gwet’s AC(1)

95% CI

Percentage agreement

Gwet’s AC(1)

95% CI

Percentage agreement

LL

UL

LL

UL

LL

UL

Nothing

0.96

0.94

0.99

98

0.96

0.93

0.98

97

0.95

0.93

0.98

97

Evidence & info

0.95

0.92

0.98

97

0.87

0.82

0.92

93

0.87

0.83

0.92

93

Trusted sources

0.97

0.95

0.99

97

0.94

0.91

0.97

95

0.95

0.93

0.97

96

Action

0.98

0.97

1.00

99

0.88

0.83

0.92

91

0.86

0.82

0.91

90

Unsure

0.99

0.98

1.00

99

0.98

0.97

1.00

99

0.98

0.96

1.00

98

  1. CI confidence interval, LL lower limit, UL upper limit. All Gwet’s AC(1) values reflect “almost perfect agreement”40. Summary statistics for irrelevant responses coded to N/A are available in the Supplementary Materials (Table S4).