Table 4 Performance of the STALNet model on Surgical Actions across different encoders.

From: TEMSET-24K: Densely Annotated Dataset for Indexing Multipart Endoscopic Videos using Surgical Timeline Segmentation

Action Name

ConvNeXt

ViT

SWIN V2

Accuracy

F1 Score

Accuracy

F1 Score

Accuracy

F1 Score

[01] Aspiration

0.97 ± 0.18

0.85 ± 0.13

0.93 ± 0.26

0.69 ± 0.27

0.97 ± 0.18

0.85 ± 0.13

[02] Bleeding

0.99 ± 0.07

0.82 ± 0.17

0.99 ± 0.10

0.67 ± 0.33

0.99 ± 0.08

0.80 ± 0.19

[03] Clipping Suture

1.00 ± 0.07

0.88 ± 0.12

0.99 ± 0.10

0.71 ± 0.28

1.00 ± 0.06

0.91 ± 0.09

[04] Debris Wash

1.00 ± 0.01

0.50 ± 0.50

1.00 ± 0.01

0.50 ± 0.50

1.00 ± 0.01

0.50 ± 0.50

[05] Deflate Rectum

0.99 ± 0.07

0.89 ± 0.10

0.99 ± 0.10

0.77 ± 0.23

0.99 ± 0.08

0.89 ± 0.11

[06] Dissection

0.93 ± 0.26

0.87 ± 0.08

0.87 ± 0.34

0.76 ± 0.16

0.93 ± 0.26

0.86 ± 0.10

[07] Fluid Wash

1.00 ± 0.05

0.76 ± 0.24

1.00 ± 0.06

0.78 ± 0.22

1.00 ± 0.06

0.73 ± 0.27

[08] Haemostatis

1.00 ± 0.03

0.85 ± 0.15

1.00 ± 0.03

0.79 ± 0.21

1.00 ± 0.03

0.85 ± 0.15

[09] Inflate Rectum

1.00 ± 0.07

0.83 ± 0.17

0.99 ± 0.08

0.70 ± 0.29

1.00 ± 0.06

0.87 ± 0.13

[10] Instrument Positioning

0.91 ± 0.29

0.82 ± 0.12

0.81 ± 0.39

0.67 ± 0.21

0.89 ± 0.32

0.80 ± 0.14

[11] Marking

1.00 ± 0.07

0.91 ± 0.08

0.99 ± 0.10

0.80 ± 0.20

0.99 ± 0.07

0.90 ± 0.09

[12] No Action

0.97 ± 0.18

0.87 ± 0.11

0.93 ± 0.25

0.77 ± 0.20

0.96 ± 0.20

0.85 ± 0.13

[13] Out of Body

0.99 ± 0.09

0.98 ± 0.02

0.99 ± 0.11

0.96 ± 0.03

0.99 ± 0.09

0.97 ± 0.02

[14] Retraction

0.95 ± 0.22

0.78 ± 0.19

0.92 ± 0.26

0.66 ± 0.30

0.94 ± 0.24

0.77 ± 0.20

[15] Scope Insertion

1.00 ± 0.07

0.95 ± 0.05

0.99 ± 0.07

0.94 ± 0.06

1.00 ± 0.06

0.96 ± 0.04

[16] Scope Positioning

0.96 ± 0.19

0.87 ± 0.11

0.92 ± 0.27

0.73 ± 0.23

0.96 ± 0.19

0.87 ± 0.11

[17] Scope Removal

1.00 ± 0.03

1.00 ± 0.00

1.00 ± 0.05

0.99 ± 0.01

1.00 ± 0.03

1.00 ± 0.00

[18] Smoke

1.00 ± 0.07

0.87 ± 0.13

0.99 ± 0.10

0.71 ± 0.28

0.99 ± 0.08

0.82 ± 0.17

[19] Specimen Removal

1.00 ± 0.03

0.97 ± 0.03

1.00 ± 0.04

0.95 ± 0.05

1.00 ± 0.02

0.99 ± 0.01

[20] Stitching

0.98 ± 0.15

0.93 ± 0.06

0.95 ± 0.21

0.85 ± 0.12

0.97 ± 0.16

0.92 ± 0.06

[21] Washout

0.99 ± 0.11

0.91 ± 0.08

0.97 ± 0.17

0.79 ± 0.20

0.99 ± 0.12

0.90 ± 0.09