Table 1 Summary of conversations and opinion change in all games.

From: Testing the limits of large language models in debating humans

Game Type

Conversation type

Did the player change opinion?

Yes

No

HH

hh

32

218

AA

aa

114

458

AH

hh

7

38

ha

4

130

ah

43

91

aa

38

110

Total

 

238

1046

  1. This table contains the opinion change outcome of all 642 completed conversations across all three game types. Conversation type indicates the type of user interaction: two humans (hh), two agents (aa), or an agent and a human (ah). For ah conversations, we show two rows where the first letter indicates for which player, agent, or human we measure opinion change. Each player in a conversation has the opportunity to change their opinion, yielding \(642 \times 2\) opinion changes. We note that incomplete conversations do not record any opinion changes, and there were cases in which one player finished re-evaluating their opinion before the time limit expired, but their conversational partner did not. See SM Table S22 for a version of this table further split by the type of player who initiated the conversation.