Table 2 TWIX often improves AI-based skill assessments across hospitals.

From: A multi-institutional study using artificial intelligence to provide reliable and fair feedback to surgeons

Skill

Hospital

w/o TWIX

TWIX

needle handling

USC

0.849 (0.06)

0.859 (0.05)

 

SAH

0.873 (0.24)

0.885 (0.02)

 

HMH

0.795 (0.19)

0.794 (0.03)

needle driving

USC

0.822 (0.05)

0.850 (0.04)

 

SAH

0.800 (0.04)

0.837 (0.03)

 

HMH

0.728 (0.05)

0.757 (0.03)

  1. Effect of TWIX on SAIS’ ability to assess the skill-level of needle handling and needle driving. Values in bold reflect improvements in performance. Note that SAIS is trained exclusively on data from USC and then deployed on data from USC, SAH, and HMH. Results are an average (standard deviation) across 10 Monte Carlo cross-validation folds.
Back to article page