Table 4 Performance of the four groups of sonographers in the diagnosis of 242 volunteers.

From: A deep-learning pipeline to diagnose pediatric intussusception and assess severity during ultrasound scanning: a multicenter retrospective-prospective study

Observers

Patients

Accuracy (95%CI)

Sensitivity (95%CI)

Specificity (95%CI)

AUC (95%CI)

FK (95%CI)

Average -AUC

ST (Median [IQR])

Junior sonographers

NON

0.921 (0.921–0.922)

0.791 (0.669–0.912)

0.950 (0.919–0.980)

0.870 (0.807–0.934)

0.734 (0.621–0.847)

0.857 (0.802–0.932)

9.46 (7.91–11.17)

NSI

0.843 (0.842–0.844)

0.848 (0.796–0.901)

0.828 (0.736–0.921)

0.838 (0.785–0.892)

0.626 (0.520–0.733)

SIP

0.905 (0.904–0.906)

0.810 (0.642–0.977)

0.914 (0.877–0.951)

0.862 (0.774–0.950)

0.547 (0.386–0.708)

Intermediate sonographers

NON

0.959 (0.958–0.959)

0.907 (0.820–0.994)

0.970 (0.946–0.994)

0.938 (0.893–0.984)

0.861 (0.777–0.945)

0.919 (0.879–0.959)

6.98 (5.89–8.03)

NSI

0.913 (0.913–0.914)

0.910 (0.868–0.952)

0.922 (0.856–0.988)

0.916 (0.877–0.955)

0.789 (0.703–0.874)

SIP

0.938 (0.938–0.938)

0.857 (0.707–1.000)

0.946 (0.916–0.976)

0.901 (0.823–0.980)

0.672 (0.519–0.826)

Senior sonographers

NON

0.988 (0.988–0.988)

0.977 (0.932–1.000)

0.990 (0.976–1.000)

0.983 (0.960–1.000)

0.958 (0.911–1.000)

0.973 (0.953–0.993)

3.14 (2.02–4.13)

NSI

0.967 (0.967–0.967)

0.966 (0.940–0.993)

0.969 (0.926–1.000)

0.968 (0.942–0.993)

0.917 (0.860–0.973)

SIP

0.979 (0.979–0.980)

0.952 (0.861–1.000)

0.982 (0.964–0.999)

0.967 (0.920–1.000)

0.878 (0.772–0.983)

AI + Junior sonographers

NON

0.983 (0.983–0.984)

0.953 (0.891–1.000)

0.990 (0.976–1.000)

0.972 (0.939–1.000)

0.943 (0.889–0.998)

0.966 (0.621–0.847)

3.66 (2.91–4.21)

NSI

0.963 (0.963–0.963)

0.961 (0.932–0.989)

0.969 (0.926–1.000)

0.965 (0.939–0.991)

0.907 (0.847–0.966)

SIP

0.971 (0.971–0.971)

0.952 (0.861–1.000)

0.973 (0.951–0.994)

0.963 (0.915–1.000)

0.835 (0.716–0.954)

  1. The time requirements are measured with stopwatches and converted to min when statistics. ST Scanning-time, AI Artificial intelligence, IQR Interquartile range.
Back to article page