Table 4 Performance of the STALNet model on Surgical Actions across different encoders.
Action Name | ConvNeXt | ViT | SWIN V2 | |||
---|---|---|---|---|---|---|
Accuracy | F1 Score | Accuracy | F1 Score | Accuracy | F1 Score | |
[01] Aspiration | 0.97 ± 0.18 | 0.85 ± 0.13 | 0.93 ± 0.26 | 0.69 ± 0.27 | 0.97 ± 0.18 | 0.85 ± 0.13 |
[02] Bleeding | 0.99 ± 0.07 | 0.82 ± 0.17 | 0.99 ± 0.10 | 0.67 ± 0.33 | 0.99 ± 0.08 | 0.80 ± 0.19 |
[03] Clipping Suture | 1.00 ± 0.07 | 0.88 ± 0.12 | 0.99 ± 0.10 | 0.71 ± 0.28 | 1.00 ± 0.06 | 0.91 ± 0.09 |
[04] Debris Wash | 1.00 ± 0.01 | 0.50 ± 0.50 | 1.00 ± 0.01 | 0.50 ± 0.50 | 1.00 ± 0.01 | 0.50 ± 0.50 |
[05] Deflate Rectum | 0.99 ± 0.07 | 0.89 ± 0.10 | 0.99 ± 0.10 | 0.77 ± 0.23 | 0.99 ± 0.08 | 0.89 ± 0.11 |
[06] Dissection | 0.93 ± 0.26 | 0.87 ± 0.08 | 0.87 ± 0.34 | 0.76 ± 0.16 | 0.93 ± 0.26 | 0.86 ± 0.10 |
[07] Fluid Wash | 1.00 ± 0.05 | 0.76 ± 0.24 | 1.00 ± 0.06 | 0.78 ± 0.22 | 1.00 ± 0.06 | 0.73 ± 0.27 |
[08] Haemostatis | 1.00 ± 0.03 | 0.85 ± 0.15 | 1.00 ± 0.03 | 0.79 ± 0.21 | 1.00 ± 0.03 | 0.85 ± 0.15 |
[09] Inflate Rectum | 1.00 ± 0.07 | 0.83 ± 0.17 | 0.99 ± 0.08 | 0.70 ± 0.29 | 1.00 ± 0.06 | 0.87 ± 0.13 |
[10] Instrument Positioning | 0.91 ± 0.29 | 0.82 ± 0.12 | 0.81 ± 0.39 | 0.67 ± 0.21 | 0.89 ± 0.32 | 0.80 ± 0.14 |
[11] Marking | 1.00 ± 0.07 | 0.91 ± 0.08 | 0.99 ± 0.10 | 0.80 ± 0.20 | 0.99 ± 0.07 | 0.90 ± 0.09 |
[12] No Action | 0.97 ± 0.18 | 0.87 ± 0.11 | 0.93 ± 0.25 | 0.77 ± 0.20 | 0.96 ± 0.20 | 0.85 ± 0.13 |
[13] Out of Body | 0.99 ± 0.09 | 0.98 ± 0.02 | 0.99 ± 0.11 | 0.96 ± 0.03 | 0.99 ± 0.09 | 0.97 ± 0.02 |
[14] Retraction | 0.95 ± 0.22 | 0.78 ± 0.19 | 0.92 ± 0.26 | 0.66 ± 0.30 | 0.94 ± 0.24 | 0.77 ± 0.20 |
[15] Scope Insertion | 1.00 ± 0.07 | 0.95 ± 0.05 | 0.99 ± 0.07 | 0.94 ± 0.06 | 1.00 ± 0.06 | 0.96 ± 0.04 |
[16] Scope Positioning | 0.96 ± 0.19 | 0.87 ± 0.11 | 0.92 ± 0.27 | 0.73 ± 0.23 | 0.96 ± 0.19 | 0.87 ± 0.11 |
[17] Scope Removal | 1.00 ± 0.03 | 1.00 ± 0.00 | 1.00 ± 0.05 | 0.99 ± 0.01 | 1.00 ± 0.03 | 1.00 ± 0.00 |
[18] Smoke | 1.00 ± 0.07 | 0.87 ± 0.13 | 0.99 ± 0.10 | 0.71 ± 0.28 | 0.99 ± 0.08 | 0.82 ± 0.17 |
[19] Specimen Removal | 1.00 ± 0.03 | 0.97 ± 0.03 | 1.00 ± 0.04 | 0.95 ± 0.05 | 1.00 ± 0.02 | 0.99 ± 0.01 |
[20] Stitching | 0.98 ± 0.15 | 0.93 ± 0.06 | 0.95 ± 0.21 | 0.85 ± 0.12 | 0.97 ± 0.16 | 0.92 ± 0.06 |
[21] Washout | 0.99 ± 0.11 | 0.91 ± 0.08 | 0.97 ± 0.17 | 0.79 ± 0.20 | 0.99 ± 0.12 | 0.90 ± 0.09 |