Table 1 Performance of DeepRhythmAI and ECG technicians compared to the consensus panel of cardiologists for critical arrhythmias
From: Artificial intelligence for direct-to-physician reporting of ambulatory electrocardiography
Accuracy (95% CI), % | True-positive rate/sensitivity, % (95% CI) | True-negative rate/specificity, % (95%CI) | PPV, % (95% CI) | NPV, % (95% CI) | F1 score, % | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
AI | Technician | AI | Technician | AI | Technician | AI | Technician | AI | Technician | AI | Technician | |
Overall average critical arrhythmias | 98.1 (97.9–98.2) | 98.4 (98.1–98.5) | 98.6 (97.7–99.4) | 80.3 (77.3–83.3) | 98.1 (97.9–98.2) | 99.2 (99.0–99.3) | 71.3 (68.5–73.9) | 82.7 (79.4–85.6) | 99.9 (99.9–100) | 99.1 (98.9–99.2) | 82.7 (80.9–84.5) | 81.5 (79.0–83.6) |
VT ≥ 10 s | 98.2 (98.1–98.3) | 99.5 (99.4–99.6) | 98.0 (94.8–100) | 64.4 (54.9–73.8) | 98.2 (98.1–98.3) | 99.8 (99.7–99.8) | 27.2 (22.8–32.3) | 67.7 (58.2–76.6) | 99.98 (99.96–100) | 99.7 (99.6–99.8) | 42.6 (37.1–48.6) | 66.0 (57.4–73.2) |
AF ≥ 30 s | 97.2 (96.5–97.9) | 97.4 (96.6–98.0) | 99.1 (97.7–100) | 90.5 (86.8–94.0) | 96.9 (96.2–97.7) | 98.4 (97.8–98.9) | 82.3 (77.8–86.8) | 88.9 (84.7–92.6) | 99.9 (99.7–100) | 98.6 (98.0–99.2) | 90.0 (87.1–92.7) | 89.7 (86.7–92.3) |
SVT ≥ 30 s | 97.4 (97.1–97.9) | 96.1 (95.5–96.7) | 97.3 (94.9–99.1) | 62.9 (56.6–69.3) | 97.4 (97.0–97.9) | 98.1 (97.7–98.4) | 70.6 (65.9–75.7) | 65.8 (59.3–72.2) | 99.8 (99.7–99.9) | 97.8 (97.2–98.3) | 81.8 (78.3–75.2) | 64.3 (58.7–69.8) |
Asystole ≥ 3.5 s | 98.5 (98.2–98.7) | 99.2 (99.0–99.4) | 100 (100–100) | 80.6 (75.0–86.0) | 98.4 (98.2–98.6) | 99.8 (99.7–99.9) | 65.7 (60.5–70.4) | 91.2 (87.8–95.6) | 100 (100–100) | 99.4 (99.2–99.6) | 79.2 (75.4–82.6) | 85.8 (82.1–89.5) |
Third-degree AV block | 99.3 (99.2–99.4) | 99.5 (99.3–99.6) | 96.4 (92.5–99.2) | 52.6 (44.0–61.6) | 99.3 (99.2–99.4) | 99.9 (99.8–99.9) | 51.2 (44.6–48.2) | 76.3 (67.1–85.4) | 100 (99.9–100) | 99.6 (99.5–99.7) | 66.9 (61.2–72.8) | 62.2 (53.9–70.0) |
