Table 2 Crowd’s feasibility (weighted vote and majority vote of crowd annotations) on a ground truth-image and scattered tiles annotated by expert.
From: Task design for crowdsourced glioma cell annotation in microscopy images
Astrocytes | Tumor cells | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
c | Weighted vote | Majority vote | c | Weighted vote | Majority vote | |||||||||
TPR | PPV | \(F_1\) | TPR | PPV | \(F_1\) | TPR | PPV | \(F_1\) | TPR | PPV | \(F_1\) | |||
Ground truth-image | 7 | 0.26 | 1.0 | 0.44 | 0.46 | 0.97 | 0.56 | 38 | 0.46 | 1.0 | 0.63 | 0.45 | 0.98 | 0.60 |
Ground truth-tiles | 23 | 0.52 | 0.50 | 0.51 | 0.57 | 0.62 | 0.59 | 96 | 0.75 | 0.78 | 0.77 | 0.63 | 0.82 | 0.71 |
