Fig. 2: The field of biomedical image analysis suffers from a notable discrepancy between the needs of those annotating the data and the actual availability of labelling instructions (if any).
From: Labelling instructions matter in biomedical image analysis
a, Professional annotators agree that unclear instructions consistently cause delay and rework. Comprehensive text descriptions and images are perceived to improve annotation quality. b, Professional annotators attribute labelling instructions as the primary cause for problems related to their daily annotation work, followed by concentration issues and poor input data. Answers for a and b were processed from 298 annotators from five annotation companies. c, Seventy-six per cent of the recent MICCAI conference competition tasks, matching the inclusion criteria, do not report any labelling instructions. The analysis includes all 96 registered MICCAI competition tasks between 2020 and 2021.
