Table 2 EchoNext model performance by patient subgroups from the NYP multicentre test set
From: Detecting structural heart disease from electrocardiograms using AI
n | Percentage SHD (%) | AUROC | AUPRC | F1 score | Odds ratio | |
|---|---|---|---|---|---|---|
Age groups | ||||||
18–59 | 17,730 | 21.8 | 85.7 [84.3–87.1] | 69.5 [66.5–72.1] | 58.7 [57.2–60.1] | 19.1 [17.2–21.2] |
60–69 | 9,745 | 34.0 | 82.1 [80.4–84.0] | 74.4 [71.4–77.3] | 63.1 [61.7–64.4] | 10.6 [9.6–11.7] |
70–79 | 9,108 | 43.8 | 80.5 [78.7–82.4] | 78.2 [75.6–80.5] | 67.7 [66.4–69.0] | 7.9 [7.2–8.7] |
80+ | 8,136 | 62.0 | 78.9 [77.0–80.8] | 86.0 [84.1–87.8] | 77.0 [76.0–77.9] | 6.5 [5.9–7.2] |
Sex | ||||||
Female | 23,280 | 31.7 | 85.6 [84.6–86.6] | 75.4 [73.2–77.2] | 65.4 [64.5–66.3] | 13.4 [12.5–14.4] |
Male | 21,439 | 41.2 | 84.4 [83.4–85.4] | 80.9 [79.4–82.4] | 69.9 [69.1–70.7] | 11.6 [10.8–12.4] |
Race/ethnicity | ||||||
Hispanic | 9,015 | 32.2 | 85.1 [83.4–86.7] | 76.0 [73.0–79.0] | 64.6 [63.1–66.1] | 13.0 [11.5–14.5] |
White | 15,841 | 35.3 | 84.8 [83.6–86.0] | 76.6 [74.5–78.7] | 67.3 [66.3–68.3] | 12.2 [11.2–13.2] |
Black | 6,479 | 40.7 | 85.2 [83.3–87.0] | 82.1 [79.6–84.5] | 70.6 [69.1–72.0] | 13.5 [11.8–15.3] |
Asian | 2,775 | 36.9 | 84.6 [81.6–87.4] | 77.3 [72.1–82.3] | 67.8 [65.4–70.2] | 11.4 [9.5–13.7] |
Other | 4,054 | 35.2 | 85.3 [82.9–87.6] | 77.6 [73.2–81.9] | 66.8 [64.5–68.9] | 12.6 [10.6–15.0] |
Unknown | 6,555 | 40.2 | 86.2 [84.4–88.0] | 82.1 [79.5–84.8] | 70.5 [69.0–71.9] | 13.1 [11.5–14.8] |
Clinical context | ||||||
Emergency | 14,807 | 34.7 | 84.1 [82.9–85.4] | 76.0 [73.7–78.1] | 65.2 [64.1–66.3] | 11.1 [10.2–12.1] |
Inpatient | 17,446 | 45.9 | 84.1 [82.8–85.3] | 82.5 [80.8–84.1] | 72.8 [72.0–73.6] | 10.6 [9.9–11.4] |
Outpatient | 11,248 | 22.4 | 84.3 [82.6–86.1] | 68.0 [64.4–71.3] | 55.7 [53.7–57.5] | 17.7 [15.6–20.2] |
Procedural | 891 | 50.5 | 82.6 [77.0–87.9] | 83.7 [77.0–89.6] | 71.1 [67.4–74.4] | 10.3 [7.4–14.4] |
Unknown | 327 | 29.7 | 79.1 [67.3–89.4] | 68.1 [48.6–83.3] | 55.6 [45.8–64.2] | 9.2 [4.9–16.7] |
Hospital | ||||||
Weill Cornell | 15,736 | 32.5 | 85.5 [84.2–86.7] | 76.9 [74.6–78.9] | 65.7 [64.5–66.8] | 13.4 [12.3–14.6] |
Brooklyn Methodist | 889 | 40.4 | 85.4 [80.1–90.4] | 82.5 [75.0–89.1] | 71.5 [67.8–75.4] | 16.8 [11.7–23.6] |
Queens | 2,558 | 39.9 | 81.7 [78.6–84.8] | 75.7 [70.3–80.6] | 65.9 [63.4–68.4] | 8.8 [7.2–10.7] |
Lower Manhattan | 1,777 | 29.3 | 86.5 [82.7–89.9] | 73.6 [65.8–80.8] | 66.5 [63.3–69.8] | 12.7 [9.9–16.0] |
Westchester | 2,270 | 33.3 | 84.5 [80.9–87.8] | 74.7 [68.3–80.3] | 67.2 [64.3–70.1] | 12.5 [10.1–15.5] |
CUIMC | 16,626 | 40.9 | 85.1 [83.9–86.2] | 81.3 [79.3–83.0] | 69.8 [68.7–70.7] | 12.4 [11.5–13.4] |
Allen | 3,612 | 38.2 | 85.2 [82.4–87.6] | 79.2 [74.4–83.1] | 69.5 [67.4–71.5] | 12.6 [10.7–15.0] |
Hudson Valley | 1,103 | 22.0 | 86.3 [81.0–91.2] | 66.0 [52.8–77.8] | 62.7 [57.6–67.7] | 14.6 [10.3–20.3] |
