Table 2 Dice coefficients for segmentation performance of Hiera Large and Hiera Base Plus backbones across multiple datasets and anatomical structures, evaluated with 1 to 10 prompt points. The weighted mean Dice coefficient for all classes is also provided to summarize overall performance trends. The best Dice score for each class for each model is highlighted in bold.
From: A fine-tuned foundational model SurgiSAM2 for surgical video anatomy segmentation and detection
Datasets and their organ classes (n = number of examples in validation subset) | Hiera-large | Hiera-base-plus | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
Number of point prompts | Number of point prompts | |||||||||||
1 | 2 | 4 | 6 | 8 | 10 | 1 | 2 | 4 | 6 | 8 | 10 | |
CholecSeg8k (4548) | ||||||||||||
 Abdominal wall (951) | 0.89 | 0.93 | 0.95 | 0.95 | 0.96 | 0.95 | 0.78 | 0.83 | 0.90 | 0.93 | 0.94 | 0.94 |
 Fat (720) | 0.70 | 0.77 | 0.76 | 0.77 | 0.79 | 0.80 | 0.72 | 0.76 | 0.77 | 0.82 | 0.84 | 0.85 |
 Gallbladder (720) | 0.84 | 0.86 | 0.88 | 0.89 | 0.89 | 0.88 | 0.78 | 0.84 | 0.88 | 0.88 | 0.88 | 0.87 |
 Gastrointestinal tract (557) | 0.83 | 0.82 | 0.91 | 0.91 | 0.92 | 0.93 | 0.60 | 0.68 | 0.76 | 0.76 | 0.72 | 0.69 |
 Liver (1600) | 0.56 | 0.68 | 0.73 | 0.77 | 0.80 | 0.83 | 0.53 | 0.64 | 0.72 | 0.76 | 0.77 | 0.75 |
Dresden (621) | ||||||||||||
 Abdominal wall (56) | 0.71 | 0.78 | 0.85 | 0.88 | 0.91 | 0.92 | 0.67 | 0.71 | 0.77 | 0.79 | 0.80 | 0.79 |
 Colon (52) | 0.67 | 0.70 | 0.76 | 0.82 | 0.82 | 0.85 | 0.65 | 0.66 | 0.76 | 0.77 | 0.76 | 0.71 |
 Inferior mesenteric artery (61) | 0.37 | 0.40 | 0.48 | 0.54 | 0.56 | 0.57 | 0.30 | 0.41 | 0.47 | 0.46 | 0.45 | 0.36 |
 Intestinal veins (49) | 0.50 | 0.55 | 0.63 | 0.67 | 0.67 | 0.68 | 0.29 | 0.45 | 0.58 | 0.59 | 0.56 | 0.51 |
 Liver (83) | 0.79 | 0.83 | 0.87 | 0.89 | 0.89 | 0.89 | 0.76 | 0.86 | 0.87 | 0.88 | 0.88 | 0.88 |
 Pancreas (42) | 0.75 | 0.72 | 0.79 | 0.82 | 0.83 | 0.83 | 0.61 | 0.68 | 0.73 | 0.72 | 0.70 | 0.65 |
 Small intestine (53) | 0.67 | 0.82 | 0.87 | 0.89 | 0.88 | 0.89 | 0.74 | 0.85 | 0.90 | 0.90 | 0.90 | 0.91 |
 Spleen (50) | 0.82 | 0.85 | 0.86 | 0.90 | 0.95 | 0.93 | 0.81 | 0.85 | 0.88 | 0.90 | 0.90 | 0.88 |
 Stomach (78) | 0.79 | 0.81 | 0.85 | 0.89 | 0.91 | 0.91 | 0.64 | 0.72 | 0.82 | 0.81 | 0.82 | 0.78 |
 Ureter (43) | 0.28 | 0.32 | 0.45 | 0.48 | 0.50 | 0.50 | 0.21 | 0.26 | 0.35 | 0.36 | 0.37 | 0.28 |
 Vesicular glands (54) | 0.45 | 0.52 | 0.59 | 0.66 | 0.67 | 0.64 | 0.33 | 0.43 | 0.51 | 0.53 | 0.54 | 0.50 |
UreterUD (115) | ||||||||||||
 Uterine artery (50) | 0.56 | 0.55 | 0.64 | 0.75 | 0.75 | 0.74 | 0.52 | 0.60 | 0.68 | 0.70 | 0.65 | 0.60 |
 Nerve (30) | 0.63 | 0.67 | 0.71 | 0.76 | 0.78 | 0.79 | 0.69 | 0.68 | 0.69 | 0.72 | 0.72 | 0.71 |
 Ureter (35) | 0.84 | 0.86 | 0.85 | 0.87 | 0.85 | 0.87 | 0.71 | 0.72 | 0.72 | 0.73 | 0.64 | 0.60 |
Endoscapes (226) | ||||||||||||
 Cystic artery (34) | 0.17 | 0.19 | 0.29 | 0.43 | 0.50 | 0.53 | 0.16 | 0.23 | 0.38 | 0.43 | 0.43 | 0.40 |
 Cystic duct (65) | 0.27 | 0.31 | 0.36 | 0.46 | 0.50 | 0.53 | 0.28 | 0.28 | 0.36 | 0.43 | 0.44 | 0.41 |
 Cystic plate (29) | 0.20 | 0.17 | 0.38 | 0.56 | 0.60 | 0.67 | 0.23 | 0.36 | 0.53 | 0.67 | 0.71 | 0.62 |
 Gallbladder (73) | 0.67 | 0.68 | 0.74 | 0.84 | 0.84 | 0.83 | 0.62 | 0.71 | 0.77 | 0.79 | 0.82 | 0.83 |
 Hepatocystic triangle (25) | 0.27 | 0.35 | 0.46 | 0.45 | 0.51 | 0.53 | 0.30 | 0.44 | 0.53 | 0.63 | 0.56 | 0.52 |
m2caiSeg (317) | ||||||||||||
 Artery (11) | 0.22 | 0.23 | 0.26 | 0.28 | 0.29 | 0.22 | 0.26 | 0.30 | 0.30 | 0.37 | 0.29 | 0.31 |
 Fat (28) | 0.43 | 0.49 | 0.55 | 0.55 | 0.60 | 0.43 | 0.46 | 0.51 | 0.51 | 0.62 | 0.63 | 0.64 |
 Gallbladder (249) | 0.51 | 0.50 | 0.55 | 0.66 | 0.71 | 0.51 | 0.43 | 0.49 | 0.58 | 0.65 | 0.65 | 0.63 |
 Intestine (7) | 0.65 | 0.84 | 0.80 | 0.84 | 0.86 | 0.65 | 0.64 | 0.48 | 0.67 | 0.75 | 0.72 | 0.67 |
 Liver (29) | 0.48 | 0.58 | 0.58 | 0.60 | 0.61 | 0.48 | 0.50 | 0.53 | 0.63 | 0.67 | 0.70 | 0.68 |
 Upperwall (22) | 0.73 | 0.74 | 0.78 | 0.82 | 0.79 | 0.73 | 0.56 | 0.62 | 0.73 | 0.79 | 0.77 | 0.75 |
 Weighted mean dice coefficient (for all tissue classes) | 0.69 | 0.75 | 0.79 | 0.82 | 0.83 | 0.84 | 0.62 | 0.70 | 0.76 | 0.79 | 0.79 | 0.79 |
 Mean dice coefficient (for all tissue classes) | 0.58 | 0.62 | 0.67 | 0.72 | 0.74 | 0.75 | 0.53 | 0.59 | 0.66 | 0.69 | 0.69 | 0.66 |