Figure 1

(a) Example of the interface. The mathematical model’s input is based on the number of bricks for each colour present in the building area. This input is displayed in the horizontal bars on the left part. The more the bricks of a specific colour, the more the bar would be filled. The outputs used to generate missions are shown in the right part of the interface. A green placeholder indicated their current value. Whenever one of the indicators became the target of a mission, a red placeholder appeared to guide the player towards the objective. (b) The installation with two gaming stations. Each gaming station had five containers to store bricks (i), a building area (ii) with an RGB/depth-sensor (iii) above it, a feedback monitor (iv) with a red button to control it (v). Brick containers (i) had labels attached on top providing a brief explanation of the brick colour meaning (e.g., “Orange bricks represents the population of the city”). (c) Scheme of user interaction during a mission. Once the player has modified the city and pressed the button, the RGB/dept-sensor translates the bricks’ number into the generative model’s input. The output is then computed as the most likely value of the probability distribution of the outputs conditioned on the input. The input corresponding to the different brick colours and the outputs are then updated simultaneously on the feedback monitor.