Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Comment
  • Published:

The missing data for intelligent scientific instruments

Most scientific instruments currently discard rich streams of commands, data and metadata from which AI systems could learn to conduct experiments with expert-level decision-making and troubleshooting skills. Recording and using this data at scale requires rethinking what data to store, incentivizing large-scale cooperation, and determining how to quantify the reliability of such autonomous systems.

This is a preview of subscription content, access via your institution

Access options

Buy this article

USD 39.95

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Training an autoregressive model from scientific instrument usage.

References

  1. Vaswani, A. et al. Attention is all you need. In Advances in Neural Information Processing Systems Vol. 30 (eds. Guyon, I. et al.) https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf (Curran, 2017).

  2. Henighan, T. et al. Preprint at arXiv https://doi.org/10.48550/arXiv.2010.14701 (2020).

  3. Jumper, J. et al. Nature 596, 583–589 (2021).

    Article  PubMed  PubMed Central  Google Scholar 

  4. Kim, M. J. et al. Preprint at arXiv https://doi.org/10.48550/arXiv.2406.09246 (2024).

  5. OECD. Artificial Intelligence in Science: Challenges, Opportunities and the Future of Research https://www.oecd.org/en/publications/artificial-intelligence-in-science_a8d820bd-en.html (OECD, 2023).

  6. Boiko, D. A., MacKnight, R., Kline, B. & Gomes, G. Nature 624, 570–578 (2023).

    Article  PubMed  PubMed Central  Google Scholar 

  7. Szymanski, N. J. et al. Nature 624, 86–91 (2023).

    Article  PubMed  PubMed Central  Google Scholar 

  8. Eisenstein, M. Nat. Methods 17, 1075–1079 (2020).

    Article  PubMed  Google Scholar 

  9. Carpenter, A. E., Cimini, B. A. & Eliceiri, K. W. Nat. Methods 20, 962–964 (2023).

    Article  PubMed  PubMed Central  Google Scholar 

  10. Griffin, C., Wallace, D., Mateos-Garcia, J., Schieve, H. & Kohli, P. A new golden age of discovery: seizing the AI for Science opportunity. AI Policy Perspectives https://www.aipolicyperspectives.com/p/a-new-golden-age-of-discovery (2024).

  11. Villalobos, P. et al. Preprint at arXiv https://doi.org/10.48550/arXiv.2211.04325 (2024).

  12. Manning, C., Raghavan, P. & Schuetze, H. Introduction to Information Retrieval (Cambridge Univ. Press, 2009).

  13. Zulueta-Coarasa, T. et al. Nat. Methods 22, 2245–2252 (2025).

    Article  PubMed  Google Scholar 

  14. Skowronek, P., Nawalgaria, A. & Mann, M. Preprint at bioRxiv https://doi.org/10.1101/2025.10.05.680425 (2025).

  15. Douillard, A. et al. Preprint at arXiv https://doi.org/10.48550/arXiv.2311.08105 (2023).

Download references

Acknowledgements

We thank Ivo Vellekoop for discussions.

Author information

Authors and Affiliations

Authors

Contributions

H.P. and N.N. conceived the project and wrote the manuscript together.

Corresponding authors

Correspondence to Henry Pinkard or Nils Norlin.

Ethics declarations

Competing interests

The authors declare no competing interests.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pinkard, H., Norlin, N. The missing data for intelligent scientific instruments. Nat Methods (2025). https://doi.org/10.1038/s41592-025-02995-7

Download citation

  • Published:

  • Version of record:

  • DOI: https://doi.org/10.1038/s41592-025-02995-7

Search

Quick links

Nature Briefing AI and Robotics

Sign up for the Nature Briefing: AI and Robotics newsletter — what matters in AI and robotics research, free to your inbox weekly.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing: AI and Robotics