Table 1 Comparison of Model Performance Based on Dice Similarity Coefficient (DSC) and Intersection over Union (IoU)

From: Foundation versus domain-specific models for left ventricular segmentation on cardiac ultrasound

Dataset	Phase	DSC					IoU
		SAM₁₁₂ (fine-tuned)	SAM (zero-shot)	MedSAM	EchoNet	U-Net	SAM₁₁₂ (fine-tuned)	SAM (zero-shot)	MedSAM	EchoNet	U-Net
EchoNet-test	Overall	0.911 ± 0.045^*†∅+	0.863 ± 0.053	0.872 ± 0.056	0.915 ± 0.047	0.640 ± 0.151	0.840 ± 0.071^*†∅+	0.763 ± 0.077	0.777 ± 0.083	0.847 ± 0.072	0.488 ± 0.157
	ED	0.929 ± 0.030^*†∅+	0.878 ± 0.040	0.893 ± 0.040	0.903 ± 0.052	0.675 ± 0.134	0.868 ± 0.050^*†∅+	0.784 ± 0.062	0.809 ± 0.062	0.826 ± 0.078	0.524 ± 0.148
	ES	0.894 ± 0.050^*†∅+	0.849 ± 0.060	0.850 ± 0.061	0.928 ± 0.038	0.606 ± 0.160	0.812 ± 0.077^*†∅+	0.742 ± 0.084	0.744 ± 0.088	0.868 ± 0.059	0.453 ± 0.159
Mayo- TTE	Overall	0.902 ± 0.032^*∅+	0.882 ± 0.036	0.883 ± 0.039	0.893 ± 0.090	0.597 ± 0.169	0.822 ± 0.051^*∅+	0.790 ± 0.056	0.792 ± 0.061	0.814 ± 0.093	0.444 ± 0.162
	ED	0.916 ± 0.024^*∅+	0.889 ± 0.037	0.903 ± 0.027	0.916 ± 0.031	0.634 ± 0.162	0.846 ± 0.040^*∅+	0.802 ± 0.058	0.825 ± 0.044	0.846 ± 0.051	0.482 ± 0.161
	ES	0.887 ± 0.032^*∅+	0.875 ± 0.033	0.862 ± 0.039	0.870 ± 0.119	0.561 ± 0.169	0.799 ± 0.050^*∅+	0.779 ± 0.052	0.760 ± 0.059	0.782 ± 0.113	0.408 ± 0.156
Mayo- POCUS	Overall	0.857 ± 0.047^†+	0.861 ± 0.043	0.846 ± 0.072	0.667 ± 0.279	0.396 ± 0.239	0.753 ± 0.070^†+	0.758 ± 0.066	0.740 ± 0.102	0.554 ± 0.265	0.275 ± 0.192
	ED	0.878 ± 0.036^†+	0.876 ± 0.032	0.868 ± 0.064	0.717 ± 0.255	0.463 ± 0.232	0.785 ± 0.056^†+	0.781 ± 0.051	0.772 ± 0.092	0.607 ± 0.253	0.329 ± 0.194
	ES	0.836 ± 0.047^†+	0.846 ± 0.048	0.825 ± 0.074	0.617 ± 0.295	0.330 ± 0.229	0.720 ± 0.069^†+	0.735 ± 0.072	0.708 ± 0.103	0.501 ± 0.270	0.221 ± 0.175
CAMUS- A2C	Overall	0.891 ± 0.040^*†∅+	0.852 ± 0.048	0.857 ± 0.057	0.752 ± 0.196	0.460 ± 0.154	0.805 ± 0.062^*†∅+	0.745 ± 0.069	0.754 ± 0.081	0.633 ± 0.196	0.311 ± 0.130
	ED	0.897 ± 0.037^*†∅+	0.860 ± 0.042	0.877 ± 0.040	0.754 ± 0.196	0.458 ± 0.135	0.815 ± 0.059^*†∅+	0.756 ± 0.062	0.783 ± 0.060	0.635 ± 0.197	0.307 ± 0.116
	ES	0.885 ± 0.041^*†∅+	0.845 ± 0.052	0.838 ± 0.065	0.751 ± 0.196	0.461 ± 0.172	0.795 ± 0.064^*†∅+	0.734 ± 0.073	0.725 ± 0.088	0.632 ± 0.196	0.315 ± 0.144
CAMUS- A4C	Overall	0.897 ± 0.036^*†∅+	0.866 ± 0.039	0.877 ± 0.044	0.850 ± 0.097	0.418 ± 0.159	0.815 ± 0.058^*†∅+	0.766 ± 0.059	0.784 ± 0.066	0.749 ± 0.117	0.277 ± 0.128
	ED	0.904 ± 0.033 ^*†∅+	0.873 ± 0.037	0.890 ± 0.035	0.850 ± 0.098	0.428 ± 0.139	0.827 ± 0.054^*†∅+	0.776 ± 0.056	0.804 ± 0.055	0.749 ± 0.119	0.282 ± 0.114
	ES	0.889 ± 0.038 ^*†∅+	0.860 ± 0.041	0.864 ± 0.048	0.850 ± 0.096	0.409 ± 0.176	0.803 ± 0.060^*†∅+	0.756 ± 0.061	0.763 ± 0.070	0.749 ± 0.115	0.272 ± 0.140

*p < 0.05, Zero-shot vs. fine-tuned SAM. †p < 0.05, Fine-tuned SAM vs. EchoNet model. ^∅p < 0.05, Fine-tuned SAM vs. MedSAM. ⁺p < 0.05, Fine-tuned SAM vs. U-Net. A2C: apical 2 chamber view, A4C: apical 4 chamber view, CAMUS: Cardiac Acquisitions for Multi-structure Ultrasound Segmentation, DSC Dice Similarity Score, ED end-diastolic, ES end-systolic, IoU Intersection over Union, SAM segment anything model, TTE transthoracic echocardiography, POCUS point-of-care ultrasound. Data expressed as mean ± standard deviation.

Back to article page

Table 1 Comparison of Model Performance Based on Dice Similarity Coefficient (DSC) and Intersection over Union (IoU)

Search

Quick links