Abstract
Artificial intelligence has made significant strides in predicting major adverse cardiovascular events (MACE) in patients with acute myocardial infarction (AMI) following percutaneous coronary intervention. However, most existing methods rely solely on tabular variables derived from clinical data and cardiac magnetic resonance (CMR), without fully leveraging the predictive potential of the CMR imaging modality itself. Moreover, these approaches often overlook the synergistic benefits of multimodal integration between imaging and tabular data. In addition, current models primarily focus on short-term MACE risk assessment (e.g., within 6 months or 1 year), limiting their applicability for long-term prognostication. To address these limitations, we first developed ReconSeg3D, a model that reconstructs short-axis cine CMR stacks into temporally-resolved 3D bi-ventricular volumes, capturing fine-grained cardiac anatomy and dynamic motion. These bi-ventricular sequences were then integrated with 45 clinical and CMR-derived variables using spatiotemporal decomposition and cross-attention mechanisms to construct a multimodal MACE prediction model—HeartTTable. HeartTTable achieved a 5-year time-dependent AUC of 0.934 (95% CI 0.907–0.959) and a Harrell’s C-index of 0.897 for predicting MACE risk, significantly outperforming models based solely on clinical and CMR-derived tabular features, and demonstrated strong capabilities in postoperative risk stratification. Our study contributes to improved long-term postoperative management for AMI patients by offering clinicians an objective, data-driven decision-support tool.
Similar content being viewed by others
Data availability
The datasets generated and analyzed during the current study are not publicly available due to privacy, ethical, and legal considerations, but are available from the corresponding author on reasonable request. The code of the model in this paper is available at https://github.com/qiang-Blazer/MACE_pred.
Code availability
The code of the model in this paper is available at https://github.com/qiang-Blazer/MACE_pred.
References
Shang, P. et al. Association between medication adherence and 1-year major cardiovascular adverse events after acute myocardial infarction in China. J. Am. Heart Assoc. https://doi.org/10.1161/JAHA.118.011793 (2019).
Schuster, A. et al. Fully automated cardiac assessment for diagnostic and prognostic stratification following myocardial infarction. JAHA 9, e016612 (2020).
Antman, E. M. et al. The TIMI risk score for unstable angina/non-ST elevation MIA method for prognostication and therapeutic decision making. JAMA 284, 835–842 (2000).
Fox, K. A. A. et al. Prediction of risk of death and myocardial infarction in the six months after presentation with acute coronary syndrome: prospective multinational observational study (GRACE). BMJ 333, 1091 (2006).
Kim, Y. J., Saqlian, M. & Lee, J. Y. Deep learning–based prediction model of occurrences of major adverse cardiac events during 1-year follow-up after hospital discharge in patients with AMI using knowledge mining. Pers. Ubiquit. Comput. 26, 259–267 (2022).
Sherazi, S. W. A., Bae, J.-W. & Lee, J. Y. A soft voting ensemble classifier for early prediction and diagnosis of occurrences of major adverse cardiovascular events for STEMI and NSTEMI during 2-year follow-up in patients with acute coronary syndrome. PLoS ONE 16, e0249338 (2021).
Chopannejad, S., Sadoughi, F., Bagherzadeh, R. & Shekarchi, S. Predicting major adverse cardiovascular events in acute coronary syndrome: a scoping review of machine learning approaches. Appl. Clin. Inform. 13, 720–740 (2022).
Huang, Z., Lu, Y. & Dong, W. Utilizing electronic health records to predict multi-type major adverse cardiovascular events after acute coronary syndrome. Knowl. Inf. Syst. 60, 1725–1752 (2019).
Kong, S. et al. A prognostic nomogram for long-term major adverse cardiovascular events in patients with acute coronary syndrome after percutaneous coronary intervention. BMC Cardiovasc. Disord. 21, 253 (2021).
Wang, J. et al. Risk prediction of major adverse cardiovascular events occurrence within 6 months after coronary revascularization: Machine Learning study. JMIR Med. Inform. 10, e33395 (2022).
Zhang, P. et al. Machine learning for early prediction of major adverse cardiovascular events after first percutaneous coronary intervention in patients with acute myocardial infarction: Retrospective Cohort Study. JMIR Form. Res. 8, e48487 (2024).
Backhaus, S. J. et al. Artificial intelligence fully automated myocardial strain quantification for risk stratification following acute myocardial infarction. Sci. Rep. 12, 12220 (2022).
Stiermaier, T. et al. Optimized prognosis assessment in ST-segment–elevation myocardial infarction using a cardiac magnetic resonance imaging risk score. Circ: Cardiovasc. Imaging 10, e006774 (2017).
Bulluck, H. et al. A noncontrast CMR risk score for long-term risk stratification in reperfused ST-segment elevation myocardial infarction. JACC: Cardiovasc. Imaging 15, 431–440 (2022).
Qiao, M. et al. A personalized time-resolved 3D mesh generative model for unveiling normal heart dynamics. Nat. Mach. Intell. 7, 800–811 (2025).
Collet, J.-P. et al. 2020 ESC guidelines for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation: The task force for the management of acute coronary syndromes in patients presenting without persistent ST-segment elevation of the European Society of Cardiology (ESC). Eur. Heart J. 42, 1289–1367 (2021).
Hagström, E. et al. Cardiovascular event rates after myocardial infarction or ischaemic stroke in patients with additional risk factors: a retrospective population-based cohort study. Adv. Ther. 38, 4695–4708 (2021).
Miao, B. et al. Incidence and predictors of major adverse cardiovascular events in patients with established atherosclerotic disease or multiple risk factors. J. Am. Heart Assoc. 9, e014402 (2020).
Klug, G. et al. Prognostic value at 5 years of microvascular obstruction after acute myocardial infarction assessed by cardiovascular magnetic resonance. J. Cardiovasc. Magn. Reson. 14, 52 (2012).
Zhang, N. et al. Deep learning for diagnosis of chronic myocardial infarction on nonenhanced cardiac Cine MRI. Radiology https://doi.org/10.1148/radiol.2019182304 (2019).
Zucker, E. J., Sandino, C. M., Kino, A., Lai, P. & Vasanawala, S. S. Free-breathing accelerated cardiac MRI using deep learning: validation in children and young adults. Radiology https://doi.org/10.1148/radiol.2021202624 (2021).
Lehmann, D. H. et al. Prediction of diagnosis and diastolic filling pressure by AI-enhanced cardiac MRI: a modelling study of hospital data. Lancet Digit. Health 6, e407–e417 (2024).
Banerjee, A. et al. A completely automated pipeline for 3D reconstruction of human heart from 2D cine magnetic resonance slices. Philos. Trans. R. Soc. A: Math. Phys. Eng. Sci.379, 20200257 (2021).
Chang, Q. et al. DeepRecon: joint 2D cardiac segmentation and 3D volume reconstruction via a structure-specific generative method. In Medical Image Computing and Computer Assisted Intervention—MICCAI 2022. Vol. 13434, 567–577 (Springer Nature, 2022).
Bai, W. et al. A bi-ventricular cardiac atlas built from 1000+ high resolution MR images of healthy subjects and an analysis of shape and motion. Med. Image Anal. 26, 133–145 (2015).
Meng, Q., Bai, W., O’Regan, D. P. & Rueckert, D. DeepMesh: mesh-based cardiac motion tracking using deep learning. IEEE Trans. Med. Imaging 43, 1489–1500 (2024).
Beetz, M., Banerjee, A. & Grau, V. Modeling 3D cardiac contraction and relaxation with point cloud deformation networks. IEEE J. Biomed. Health Inform. 28, 4810–4819 (2024).
Bello, G. A. et al. Deep-learning cardiac motion analysis for human survival prediction. Nat. Mach. Intell. 1, 95–104 (2019).
Zhuang, X. & Shen, J. Multi-scale patch and multi-modality atlases for whole heart segmentation of MRI. Med. Image Anal. 31, 77–87 (2016).
Bernard, O. et al. Deep learning techniques for automatic MRI cardiac multi-structures segmentation and diagnosis: is the problem solved? IEEE Trans. Med. Imaging 37, 2514–2525 (2018).
Liu, H. et al. Development and evaluation of a live birth prediction model for evaluating human blastocysts from a retrospective study. eLife 12, e83662 (2023).
Zolotarev, A. M., Khan, A. K. R., Slabaugh, G. & Roney, C. H. Predicting Atrial Fibrillation Treatment Outcome with Siamese Multi-modal Fusion and Cardiac Digital Twins. In Proc. of the 7th International Conference on Medical Imaging with Deep Learning. 250, 1927–1938 (PMLR, 2024).
Ding, J.-E., Hsu, C.-C. & Liu, F. Parkinson’s disease classification using contrastive graph cross-view learning with multimodal fusion of spect images and clinical features. In 2024 IEEE International Symposium on Biomedical Imaging (ISBI) 1–5 (IEEE, 2024).
Liu, Z., Wei, J., Li, R. & Zhou, J. SFusion: Self-attention based N-to-one multimodal fusion block. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2023. Vol. 14221, 159–169 (Springer Nature Switzerland, Cham, 2023).
Simon, B. D., Ozyoruk, K. B., Gelikman, D. G., Harmon, S. A. & Türkbey, B. The future of multimodal artificial intelligence models for integrating imaging and clinical metadata: a narrative review. Diagn. Interv. Radiol. https://doi.org/10.4274/dir.2024.242631 (2024).
Brown, A. J. et al. Plaque structural stress estimations improve prediction of future major adverse cardiovascular events after intracoronary imaging. Circ: Cardiovasc. Imaging 9, e004172 (2016).
Qiao, M. et al. CHeart: a conditional spatio-temporal generative model for cardiac anatomy. IEEE Trans. Med. Imaging 43, 1259–1269 (2024).
Amano, Y. et al. Three-dimensional cardiac MR imaging: related techniques and clinical applications. Magn. Reson. Med. Sci. 16, 183–189 (2017).
Alkassar, M. et al. Comparative study of 2D-cine and 3D-wh volumetry: revealing systemic error of 2D-cine volumetry. Diagnostics (Basel) 13, 3162 (2023).
Pandey, R. K. & Rathore, Y. K. Deep learning in 3D cardiac reconstruction: a systematic review of methodologies and dataset. Med. Biol. Eng. Comput.https://doi.org/10.1007/s11517-024-03273-y (2025).
Ye, M., Yang, D., Kanski, M., Axel, L. & Metaxas, D. Neural deformable models for 3D bi-ventricular heart shape reconstruction and modeling from 2D sparse cardiac magnetic resonance imaging. In 2023 IEEE/CVF International Conference on Computer Vision (ICCV) 14201–14210 (IEEE, 2023).
Duan, J. et al. Automatic 3D bi-ventricular segmentation of cardiac images by a shape-refined multi- task deep learning approach. IEEE Trans. Med. Imaging 38, 2151–2164 (2019).
Tayebi Arasteh, S. et al. Automated segmentation of 3D cine cardiovascular magnetic resonance imaging. Front. Cardiovasc. Med. 10, 1167500 (2023).
Hutyra, M., Paleček, T. & Hromádka, M. The use of echocardiography in acute cardiovascular care. Summary of the document prepared by the Czech Society of Cardiology. Cor Vasa 60, e70–e88 (2018).
Koo, T. K. & Li, M. Y. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropr. Med. 15, 155–163 (2016).
Bonett, D. G. Sample size requirements for estimating intraclass correlations with desired precision. Stat. Med. 21, 1331–1335 (2002).
Bulluck, H., Dharmakumar, R., Arai, A. E., Berry, C. & Hausenloy, D. J. Cardiovascular magnetic resonance in acute ST-segment–elevation myocardial infarction. Circulation 137, 1949–1964 (2018).
Liu, T. et al. Intramyocardial hemorrhage and the ‘wave front’ of reperfusion injury compromising myocardial salvage. J. Am. Coll. Cardiol. 79, 35–48 (2022).
Hicks, K. A. et al. 2014 ACC/AHA key data elements and definitions for cardiovascular endpoint events in clinical trials. JACC 66, 403–469 (2015).
Hicks, K. A. et al. 2017 cardiovascular and stroke endpoint definitions for clinical trials. JACC 71, 1021–1034 (2018).
Thygesen, K. et al. Fourth Universal Definition of Myocardial Infarction. Circulation 138, e618–e651 (2018).
Andersen, B. K. et al. Quantitative flow ratio versus fractional flow reserve for coronary revascularisation guidance (FAVOR III Europe): a Multicentre, Randomised, Non-inferiority Trial. Lancet 404, 1835–1846 (2024).
Nguyen, T. L. et al. Prognostic value of high sensitivity troponin T after ST-segment elevation myocardial infarction in the era of cardiac magnetic resonance imaging. Eur. Heart J. Qual. Care Clin. Outcomes 2, 164–171 (2016).
van Rijsingen, I. A. W. et al. Gender-specific differences in major cardiac events and mortality in lamin A/C mutation carriers. Eur. J. Heart Fail. 15, 376–384 (2013).
Rueckert, D. et al. Nonrigid registration using free-form deformations: Application to breast MR images. IEEE Trans. Med. Imaging 18, 712–721 (1999).
Acknowledgements
This study was supported by the National Youth Talent Support Program, National Natural Science Foundation of China (82171884, 82471931), Shanghai Municipal Commission of Science and Technology Medical Innovation Research Special Project (23Y11906900), Shanghai “Yiyuan New Star” Outstanding Youth Talent (Excellent Program), the Science and Technology Commission of Shanghai Municipality (STCSM) (Nos. 23JS1400700, 24JS2840200, and 25JS2850100), the Neil Shen’s SJTU Medical Research Fund.
Author information
Authors and Affiliations
Contributions
Q.G., J.W., H.L., and L.W. developed the concept for the manuscript. Q.G. and J.W. contributed to the drafting of the manuscript. Q.G. designed the model and presented the results. Q.G. and J.W. analyzed the data. Y.G., Y.R., X.W., D.M., L.Z., H.L., and L.W. contributed to critical revision of the manuscript. G.Z., J.X., D.A., L.X., Y.Z., J.P., and L.Z. contributed to providing medical data and advice.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
About this article
Cite this article
Gao, Q., Wu, J., Gao, Y. et al. 3D Spatiotemporal cardiac reconstruction for predicting MACE in acute myocardial infarction. npj Digit. Med. (2026). https://doi.org/10.1038/s41746-026-02449-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41746-026-02449-0
