Fig. 5

Results for groups and . a) Results of Bayes A/B test when initial match \(Q =0\) for groups and : The plot shows the Bayes posterior of conditional matching rate \(\theta _0\) for both groups. The table shows the estimated difference in \(\theta _0\), the estimation error, the evidence ratio (Bayes factor) and the posterior probability for the hypothesis stating that \(\theta _0\) is larger in Group than in Group . b) Results of Bayes A/B test when initial match \(Q =1\) for groups and : The plot shows the Bayes posterior of conditional matching rate \(\theta _1\) for both groups. The table shows the estimated difference in \(\theta _1\), the estimation error, the evidence ratio (Bayes factor) and the posterior probability for the hypothesis stating that \(\theta _1\) is larger in Group than in Group . c) Empirical matching rate of participants with the optimal guess stratified by initial matching rate and whether the initial guess agrees with the AI confidence. Bins with 10 or less data points are omitted for sake of clarity.