Fig. 1: Exploration task.

In the Maggie’s farm task, participants had to choose from three bandits (depicted as trees) to maximise their overall reward. The rewards (apple size) of each bandit followed a normal distribution with a fixed sampling variance. a At the beginning of each trial, participants are provided with some initial samples (number varied depending on the bandits present on that trial) on the wooden crate at the bottom of the screen and participants had to select which bandit they want to sample from next. b Depending the condition, they can either perform one draw (short horizon) or six draws (long horizon). The empty spaces on the wooden crate (and the position of the sun) indicate how many draws they have left. Image adapted from our previous study²³.