Fig. 4: Evaluation of segmentation accuracy on spatial transcriptomics data.
From: CelloType: a unified model for segmentation and classification of tissue images
a, A line plot showing AP across IoU thresholds for cell segmentation using Xenium data by SCS, Baysor, CelloType_T (use transcript signal only) and CelloType (use transcript plus DAPI signals). Each data point represents the average AP from a 10-fold cross-validation experiment. The band width around each line represents the standard deviation. The mean and standard deviation of average AP values across IoU thresholds are shown in the parentheses. b, A line plot showing AP values across IoU thresholds for nuclear segmentation using MERFISH data. CelloType_D (use DAPI signal only) and CelloType (use transcript plus DAPI signals). c, Representative results of cell segmentation of human lung tissue imaged using Xenium protocol. Blue, nuclear signal (DAPI); green, transcripts signal; white, cell boundary. d, Representative results of cell segmentation of mouse colon tissue imaged using the MERFISH protocol. e,f, Two representative results of nuclear segmentation of human brain tissue imaged using the MERFISH protocol.
