Fig. 3
From: From sleep staging to spindle detection: a case study on end-to-end automated sleep analysis
Comparison of model-expert agreement for spindle detection with inter-rater agreement among human annotators on the MODA dataset. The red square (\(\blacksquare\)) and orange diamond (\(\blacklozenge\)) symbols indicate the agreement between the SUMOv2 model and individual MODA experts (STD as shaded area) or a consensus of all MODA experts, respectively. Inter-agreement levels between expert pairs on the MODA dataset are shown in the histogram (blue bars) and its density estimate (blue curve). The average of this distribution is shown as a blue circle (\(\bullet\)). To contextualize these results across different datasets and experts, we show the average model-expert agreement between SUMOv2 and the two DREAMS experts (\(\blacktriangle\) and \(\blacktriangleright\)), as well as between SUMOv2 and the BD expert when using expert-annotated N2 sleep stages (\(\star\)) or N2 sleep stages detected by the RSN model (+), respectively.
