Table 3 Comparison of accuracy and false alarm counts per 1,000 patients between TEWS and MEWS with similar sensitivity.

From: Development and validation of a transformer model-based early warning score for real-time prediction of adverse outcomes in the emergency department

 

Sensitivity, % (95% CI)

Specificity, % (95% CI)

PPV, % (95% CI)

NPV, % (95% CI)

False alarm counts per 1,000 patients (95% CI)

Vasopressor use

MEWS ≥ 5

49.0 (46.6–51.5)

96.8 (96.7–96.9)

18.6 (17.5–19.8)

99.2 (99.2–99.3)

32 (30.4–32.6)

TEWS ≥ 0.983

49.6 (47.1–51.9)

99.5* (99.5–99.5)

56.6* (53.9–59.2)

99.3* (99.3–99.4)

5* (4.6–5.4)

Respiratory support

MEWS ≥ 5

37.1 (34.4–40.0)

96.4 (96.3–96.5)

9.5 (8.6–10.4)

99.3 (99.3–99.4)

35 (34.3–36.5)

TEWS ≥ 0.975

38.5 (35.9–41.4)

99.0* (98.9–99.0)

25.3* (23.2–27.3)

99.4* (99.4–99.5)

10* (9.7–10.8)

ICU admission

MEWS ≥ 5

29.1 (27.2–30.9)

96.5 (96.4–96.6)

15.3 (14.3–16.3)

98.4 (98.4–98.5)

34 (33.0-35.2)

TEWS ≥ 0.921

29.1 (27.3–31.0)

98.7* (98.6–98.8)

29.7* (27.9–31.6)

98.7* (98.6–98.7)

13* (12.2–13.4)

Septic shock

MEWS ≥ 5

53.4 (50.5–56.4)

96.6 (96.5–96.7)

13.2 (12.3–14.2)

99.5 (99.5–99.6)

34 (32.5–34.6)

TEWS ≥ 0.976

54.3 (51.2–57.2)

99.3* (99.2–99.3)

38.0* (35.3–40.4)

99.6* (99.6–99.7)

7* (6.8–7.8)

Cardiac arrest

MEWS ≥ 5

38.2 (29.7–46.6)

96.0 (95.9–96.1)

1.1 (0.8–1.4)

99.9 (99.9–99.9)

40 (38.6–41.0)

TEWS ≥ 0.872

38.9 (30.4–47.3)

97.8* (97.8–97.9)

1.8* (1.3–2.3)

100.0* (99.9–100.0)

22* (20.8–22.3)

  1. TEWS, Transformer-Based Early Warning Score; MEWS, Modified Early Warning Score; PPV, Positive Predictive Value; NPV, Negative Predictive Value; CI, Confidence Interval.
  2. *P < 0.05 compared with MEWS.
Back to article page