Table 6 Comparative diagnostic performance between SpAgents and physicians across clinical specialties

From: Early diagnosis of axial spondyloarthritis in primary care using multi-agent systems

 

Sensitivity(95% CI)

P value

Specificity(95% CI)

P value

Accuracy(95% CI)

P value

F1-score(95% CI)

P value

SpAgents

0.9400(0.8742–1.0000)

 

0.7800(0.6652–0.8848)

 

0.8600(0.7920–0.9280)

 

0.8704 (0.8000–0.9358)

 

Primary Care Physicians

Doctor 1 (5 year)

without SpAgentsa

0.6800 (0.5507–0.8093)

<0.001

0.8000 (0.6891–0.9109)

1.00

0.7400 (0.6540–0.8260)

0.04

0.7234 (0.6154–0.8173)

0.19

with SpAgents-2 week

0.8400 (0.7384–0.9416)

0.04

0.8400 (0.7384–0.9416)

0.77

0.8400 (0.7681–0.9119)

0.01

0.8400 (0.7578–0.9076)

0.01

with SpAgents-3 monthb

0.8800 (0.7959–0.9600)

<0.001

0.8200 (0.7111–0.9167)

0.488

0.8500 (0.7800–0.9200)

0.011

0.8544 (0.7783–0.9231)

<0.001

 Doctor 2 (8 years)

 without SpAgentsa

0.6200 (0.4855–0.7545)

<0.001

0.9400 (0.8742–1.0000)

0.03

0.7800 (0.6988–0.8612)

0.180

0.7381 (0.6250–0.8409)

0.01

 with SpAgents-2 week

0.8000 (0.6891–0.9109)

0.02

0.8200 (0.7135–0.9265)

0.08

0.8100 (0.7331–0.8869)

<0.001

0.8081 (0.7143–0.8866)

0.08

 with SpAgents-3 monthb

0.8200 (0.7154–0.9224)

0.002

0.8400 (0.7420–0.9311)

0.092

0.8300 (0.7600–0.9000)

<0.001

0.8283 (0.7513–0.8987)

0.038

Doctor 3 (15 years)

 without SpAgentsa

0.4400 (0.3024–0.5776)

<0.001

0.9200 (0.8392–0.9813)

0.10

0.7100 (0.6211–0.7989)

0.01

0.6027 (0.4615–0.7180)

0.14

 with SpAgents-2 week

0.7600 (0.6416–0.8784)

<0.001

0.9200 (0.8448–0.9952)

0.25

0.8400 (0.7681–0.9119)

<0.001

0.8261 (0.7272–0.9053)

<0.001

 with SpAgents-3 monthb

0.8000 (0.6764–0.9111)

<0.001

0.9000 (0.8163–0.9787)

0.865

0.8500 (0.7800–0.9152)

0.002

0.8421 (0.7558–0.9111)

0.001

Rheumatologists

Doctor 4 (1 year)

 without SpAgentsa

0.3400 (0.2087–0.4713)

<0.001

0.9600 (0.9057–1.0000)

0.02

0.6500 (0.5565–0.7435)

0.002

0.4928 (0.3379–0.6342)

0.02

 with SpAgents-2 week

0.6800 (0.5507–0.8093)

<0.001

0.9400 (0.8742–1.0000)

1.00

0.8100 (0.7331–0.8869)

<0.001

0.7816 (0.6665–0.8696)

<0.001

 with SpAgents-3 monthb

0.7400 (0.6092–0.8515)

<0.001

0.8800 (0.7778–0.9600)

0.984

0.8100 (0.7300–0.8800)

<0.001

0.7957 (0.6966–0.8763)

<0.001

Doctor 5 (6 years)

 without SpAgentsa

0.8600 (0.7638–0.9562)

0.340

0.8600 (0.7638–0.9562)

0.290

0.8600 (0.7920–0.9280)

0.810

0.8603 (0.7875–0.9263)

0.91

 with SpAgents-2 week

0.9200 (0.8448–0.9952)

0.51

0.9000 (0.8168–0.9832)

0.48

0.9100 (0.8539–0.9661)

<0.001

0.9035 (0.7936–0.9301)

0.08

 with SpAgents-3 monthb

0.9400 (0.8696–1.0000)

0.149

0.8800 (0.7778–0.9619)

0.517

0.9100 (0.8548–0.9600)

0.03

0.9126 (0.8526–0.9636)

0.065

Doctor 6 (12 years)

 without SpAgentsa

0.8800 (0.7899–0.9701)

0.50

0.9000 (0.8168–0.9832)

0.08

0.8900 (0.8287–0.9513)

0.63

0.8889 (0.8139–0.9444)

0.97

 with SpAgents-2 week

0.9400 (0.8742–1.0000)

0.25

0.9200 (0.8448–0.9952)

1.00

0.9300 (0.8800–0.9800)

<0.001

0.9307 (0.8764–0.9787)

0.02

 with SpAgents-3 monthb

0.9200 (0.8247–0.9923)

0.315

0.9400 (0.8645–1.0000)

0.736

0.9300 (0.8700–0.9800)

0.028

0.9293 (0.8601–0.9775)

0.044

Orthopedist

Doctor 7 (10 years)

 without SpAgentsa

0.8600 (0.7638–0.9562)

0.29

0.7400 (0.6184–0.8616)

0.75

0.8000 (0.7216–0.8784)

0.24

0.8113 (0.7200–0.8908)

0.34

 with SpAgents-2 week

0.9800 (0.9412–1.0000)

0.08

0.7000 (0.5730–0.8270)

0.48

0.8400 (0.7681–0.9119)

<0.001

0.8596 (0.7916–0.9219)

0.06

 with SpAgents-3 monthb

0.9800 (0.9332–1.0000)

0.04

0.7200 (0.5957–0.8470)

0.778

0.8500 (0.7800–0.9200)

<0.001

0.8673 (0.7943–0.9355)

0.052

  1. Doctor 1, Doctor 2 and Doctor 3 are from the general medicine department, with clinical experience of 5 year, 8 years, and 15 years, respectively. Doctor 4, Doctor 5 and Doctor 6 are from the rheumatology department, with clinical experience of 1 year, 6 years, and 12 years, respectively. Doctor 7 is from the orthopedics department, with 10 years of clinical experience. § The P value for the comparison between SpAgents and doctors without SpAgents. ¶ The P value for the comparison between doctors without SpAgents and doctors with SpAgents after a 2-week washout period. # The P value for the comparison between doctors without SpAgents and doctors with SpAgents after a 3-month clearance period. Boldface values indicate the P values with statistically significant differences.
Back to article page