Table 2 Performance of DeepRhythmAI and ECG technicians compared to the consensus panel of cardiologists for noncritical arrhythmias
From: Artificial intelligence for direct-to-physician reporting of ambulatory electrocardiography
Accuracy, % (95% CI) | Sensitivity, % (95% CI) | Specificity, % (95% CI) | PPV, % (95% CI) | NPV, % (95% CI) | F1 score, % | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
AI | Technician | AI | Technician | AI | Technician | AI | Technician | AI | Technician | AI | Technician | |
Second-degree AV block | 92.3 (91.7–92.9) | 96.7 (95.7–97.4) | 100 (100–100) | 38.6 (30.9–46.1) | 91.9 (91.3–92.5) | 99.5 (99.3–99.7) | 41.9 (37.3–46.3) | 77.8 (68.9–87.0) | 100 (100–100) | 97.1 (96.1–97.9) | 59.1 (54.3–63.3) | 51.6 (43.7–59.2) |
2.0–3.5 s pauses | 95.0 (93.7–96.3) | 90.3 (87.4–92.5) | 97.8 (95.1–100.0) | 48.8 (40.1–57.7) | 94.5 (93.0–96.0) | 97.8 (96.7–98.8) | 78.0 (71.9–84.3) | 80.5 (70.4–89.3) | 99.5 (99.0–100.0) | 91.3 (88.1–93.6) | 86.8 (82.8–90.5) | 60.8 (52.0–68.0) |
VT 3 beats, 10 s | 81.9 (78.6–85.2) | 84.7 (80.0–88.7) | 100.0 (100.0–100.0) | 58.3 (48.8–67.7) | 75.8 (72.6–79.3) | 95.7 (93.6–97.8) | 58.5 (50.9–66.1) | 84.8 (76.8–92.4) | 100.0 (100.0–100.0) | 84.7 (79.2–89.0) | 73.8 (67.5–79.6) | 69.1 (61.3–76.7) |
AIVR | 85.5 (82.6–88.4) | 81.3 (77.2–84.8) | 100.0 (100.0–100.0) | 52.5 (42.4–62.0) | 81.1 (78.1–84.3) | 90.1 (87.5–92.4) | 61.6 (53.8–69.2) | 61.6 (50.6–71.1) | 100.0 (100.0–100.0) | 86.2 (81.5–90.2) | 76.2 (70.0–81.8) | 56.7 (47.3–64.6) |
IVR | 93.0 (92.0–94.1) | 92.8 (90.4–94.6) | 100.0 (100.0–100.0) | 29.7 (22.1–38.2) | 92.4 (91.4–93.5) | 98.9 (98.4–99.4) | 54.0 (47.5–61.1) | 72.9 (60.0–85.7) | 100.0 (100.0–100.0) | 93.6 (91.0–95.4) | 70.1 (64.4–75.9) | 42.2 (32.9–51.1) |
SVT 3 beats, 30s | 79.1 (73.1–84.6) | 76.9 (71.0–82.3) | 100.0 (100.0–100.0) | 90.3 (84.2–96.0) | 55.8 (49.6–62.9) | 62.9 (56.4–70.4) | 71.6 (63.4–79.1) | 71.8 (63.5–79.4) | 100.0 (100.0–100.0) | 86.2 (77.7–94.1) | 83.5 (77.6–88.4) | 80.0 (73.9–85.1) |
EAR ≥ 3 beats | 83.0 (78.7–87.6) | 64.8 (59.4–70.2) | 99.1 (96.8–100.0) | 56.6 (45.9–67.4) | 70.1 (65.0–75.9) | 68.9 (64.7–73.2) | 72.7 (65.7–79.7) | 48.0 (38.0–58.0) | 99.0 (96.5–100.0) | 75.8 (68.7–82.2) | 83.8 (78.9–88.7) | 51.9 (43.0–60.5) |
