Table 1 We iteratively established the task design to ensure the quality of crowd annotations.
From: Task design for crowdsourced glioma cell annotation in microscopy images
Pilot experiment | Crowd | Target parameter | Number of MSIs |
|---|---|---|---|
PE1 | 18 volunteers | Tile size | 13 |
PE2 | 25 high school students | Crowd size, instruction | 4 |
PE3 | 10 volunteers | Number of MSIs, instruction | 4 |
PE4 | 35 Amazon Mechanical Turk workers | Instruction | 8 |
