Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Comment
  • Published:

Principles to guide clinical AI readiness and move from benchmarks to real-world evaluation

Nature Medicine volume 32, pages 802–804 (2026)Cite this article

Subjects

We propose straightforward principles to foster an evaluation-forward operating system that can transform the adoption of clinical artificial intelligence from a leap of faith into a stepwise, trust-building process.

This is a preview of subscription content, access via your institution

Access options

Buy this article

  • Purchase on SpringerLink
  • Instant access to the full article PDF.

USD 39.95

Prices may be subject to local taxes which are calculated during checkout

References

  1. Singhal, K. et al. Nat. Med. 31, 943–950 (2025).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Nori, H. et al. Preprint at https://doi.org/10.48550/arXiv.2506.22405 (2025).

  3. Bedi, S. et al. JAMA 333, 319–328 (2025).

    Article  PubMed  PubMed Central  Google Scholar 

  4. Gallifant, J. et al. Nat. Med. 31, 60–69 (2025).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Escobar, G. J. et al. N. Engl. J. Med. 383, 1951–1960 (2020).

    Article  PubMed  PubMed Central  Google Scholar 

  6. Adams, R. et al. Nat. Med. 28, 1455–1460 (2022).

    Article  CAS  PubMed  Google Scholar 

  7. Johri, S. et al. Nat. Med. 31, 77–86 (2025).

    Article  CAS  PubMed  Google Scholar 

  8. Kompa, B., Snoek, J. & Beam, A. L. NPJ Digit. Med. 4, 4 (2021).

    Article  PubMed  PubMed Central  Google Scholar 

  9. Saria, S. Not all AI is created equal: strategies for safe and effective adoption. NEJM Catal. (2022).

  10. Williams, C. Y. K. et al. JAMA Int. Med. 185, 818–825 (2025).

    Article  Google Scholar 

  11. Tu, T. et al. Nature 642, 442–450 (2025).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Williams, C. Y. K. et al. JAMA Netw. Open 7, e248895 (2024).

    Article  PubMed  PubMed Central  Google Scholar 

  13. Henry, K. E. et al. Nat. Med. 28, 1447–1454 (2022).

    Article  CAS  PubMed  Google Scholar 

  14. Lång, K. et al. Lancet Oncol. 24, 936–944 (2023).

    Article  PubMed  Google Scholar 

  15. Beede, E. et al. In Proc. 2020 CHI Conference on Human Factors in Computing Systems https://doi.org/10.1145/3313831.3376718 (ACM, 2020).

Download references

Author information

Author notes

  1. These authors contributed equally: Tej D. Azad, Suchi Saria.

Authors and Affiliations

  1. Department of Neurosurgery, Johns Hopkins Hospital, Baltimore, MD, USA

    Tej D. Azad

  2. Yale School of Medicine, New Haven, CT, USA

    Harlan M. Krumholz

  3. Johns Hopkins University, Baltimore, MD, USA

    Suchi Saria

  4. Bayesian Health, New York, NY, USA

    Suchi Saria

Authors
  1. Tej D. Azad
    View author publications

    Search author on:PubMed Google Scholar

  2. Harlan M. Krumholz
    View author publications

    Search author on:PubMed Google Scholar

  3. Suchi Saria
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Suchi Saria.

Ethics declarations

Competing interest

The authors declare no competing interests.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Azad, T.D., Krumholz, H.M. & Saria, S. Principles to guide clinical AI readiness and move from benchmarks to real-world evaluation. Nat Med 32, 802–804 (2026). https://doi.org/10.1038/s41591-025-04198-1

Download citation

  • Published:

  • Version of record:

  • Issue date:

  • DOI: https://doi.org/10.1038/s41591-025-04198-1

Search

Advanced search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing