Table 2 Optical data collection types and purpose in included studies

From: Systematic review of machine learning applications using nonoptical motion tracking in surgery

Index

Author

Year

Optical Type

Purpose

1

Ahmidi, N72.

2015

Kinect (RGB and IR)

Annotate tool usage times

2

Ahmidi, N21.

2017

Robotic endoscope video

Annotate gesture type

Robotic endoscope video

Model training and validation

3

Albasri, S12.

2020

Robotic endoscope video

Grade skill level

4

van Amsterdam, B63.

2019

Robotic endoscope video

Annotate gesture type

5

van Amsterdam, B45.

2020

Robotic endoscope video

Annotate gesture type

6

van Amsterdam, B22.

2022

Robotic endoscope video

Annotate gesture type; Model training and validation

2022

Robotic endoscope video

Annotate gesture type; Model training and validation

7

Brown, J.D85.

2017

Robotic endoscope video

Grade skill level

8

Brown, K.C32.

2020

Robotic endoscope video

Annotate start/stop times of tasks

9

Chen. A.B39.

2021

Robotic endoscope video

Annotate start/stop times of tasks

10

Despinoy, F61.

2016

Robotic endoscope video

Annotate gesture type

11

DiPietro, R14.

2019

Robotic endoscopic video

Annotate manoeuvre type

Robotic endoscopic video

Annotate gesture type

12

Ershad, M76.

2019

Videos of subject, video of task

Crowdsourced stylistic labelling

13

Fard, M.J64.

2016

Robotic endoscope video

Annotate gesture type

14

Fard, M.J53.

2018

Robotic endoscope video

Grade skill level

15

Forestier, G15.

2018

Robotic endoscope video

Annotate gesture type

Robotic endoscope video

Annotate gesture type

16

Gao, Y23.

2016

Robotic endoscope video

Annotate gesture type

Robotic endoscope video

Annotate gesture type

17

Goldbraikh, A81.

2022

Videos of subject, video of task

Annotate tool usage and gesture type

18

Goldbraikh, A24.

2024

Video of subject, video of task

Annotate gesture and manoeuvre type

Video of subject, video of task

Annotate gesture and manoeuvre type

Robotic endoscope video

Annotate gesture and manoeuvre type

19

Hung, A.J68.

2022

Robotic endoscope video

Annotate manoeuvre type; Grade skill level

20

Itzkovich, D25.

2019

Robotic endoscope video

Annotate gesture type

Robotic endoscope video

Annotate gesture type

21

Itzkovich, D26.

2022

Robotic endoscope video

Annotate gesture type

Robotic endoscope video

Annotate gesture type

Robotic endoscope video

Annotate gesture type

22

Jiang, J73.

2017

Robotic endoscope video

Annotate instrument trajectories; Annotate start/stop times of tasks

23

Kelly, J.D40.

2020

Laparoscopic video

Grade skill level (via expert and crowdsourcing)

24

Khan, A86.

2020

Video of subject

Annotate gesture type; Grade skill level

25

Lea, C65.

2016

Robotic endoscope video

Annotate gesture type

26

Lee, E.J19.

2019

Laparoscopic video

Model training and validation

Laparoscopic video

Model training and validation

27

Liu, J34.

2023

Robotic endoscope video

Annotation of tools; Model training and validation

28

Long, Y27.

2021

Robotic endoscope video

Annotate gesture type; Model training and validation

Robotic endoscope video

Annotate gesture type; Model training and validation

29

Loukas, C75.

2013

Video of task

Annotate manoeuvre type

30

Loukas, C77.

2011

Video of task

Assistance in interpretation of signals

31

Loukas, C78.

2013

Video of task

Assistance in interpretation of signals; Annotate gesture type

32

Meißner, C84.

2014

Video of instrument tray, video of task

Annotate active tool usage times; Annotate gesture type

33

Murali, A66.

2016

Robotic endoscope video

Annotate gesture type; Model training and validation

34

Nguyen, X.A17.

2019

Video of task

Grade skill level

35

Oquendo, Y.A71.

2018

Video of subject

Grade skill level

36

Pachtrachai, K30.

2021

Robotic endoscope video

Annotation of tools; Model training and validation

Robotic endoscope video

Annotation of tools; Model training and validation

37

Peng, W62.

2019

Robotic virtual reality video

Annotate gesture type

38

Qin, Y28.

2020

Robotic endoscope video

Annotate gesture type; Model training and validation

Robotic endoscope video

Annotate gesture type; Model training and validation

39

Qin, Y29.

2020

Robotic endoscope video

Annotate gesture type; Model training and validation

Robotic endoscope video

Annotate gesture type; Model training and validation

40

Reiley, C.E60.

2010

Robotic endoscope video

Annotate manoeuvre type

41

Rocha, C.D31.

2019

Robotic endoscope video

Annotation of tools; Model training and validation

Robotic endoscope video

Annotation of tools; Model training and validation

Robotic endoscope video

Annotation of tools; Model training and validation

42

Rosen, J33.

2001

Video of task

Annotate gesture type

43

Sabique, P.V35.

2023

Video of task

Annotate tool motion; Model training and validation

44

Sewell, C69.

2008

Video of task

Grade skill level

45

Song, W80.

2006

Video of task

Model training and validation

46

Tatinati, S94.

2017

IR stylus

Model training

47

Tatinati, S95.

2015

IR stylus

Model training

48

Wang, Z.H43.

2018

Video of subject

Grade skill level

49

Wang, Z44.

2018

Robotic endoscope video

Annotate gesture type

50

Zhang, D20.

2020

Microscope video, video of task

Annotate tool motion; Model training and validation

Robotic endoscope video

Annotate manoeuvre type

51

Zhao, H59.

2018

Robotic endoscope video

Annotation of tools; Model training and validation

52

Zheng, Y74.

2022

Video of task

Grade skill level; Error and peg transfer counting; Annotate frames as “stressed” or “normal”

53

Zia, A18.

2018

Video of task

Annotate manoeuvre type

Video of task

Model training and validation

54

Zia, A37.

2019

Endoscopic video

Model training and validation

  1. An overview of the optical data collection methods employed in the included studies, detailing their specific purposes within the experimental models.