Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Advertisement

Nature Communications
  • View all journals
  • Search
  • My Account Login
  • Content Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • RSS feed
  1. nature
  2. nature communications
  3. articles
  4. article
Synthetic data-driven deep learning for label-free autonomous atomic force microscopy
Download PDF
Download PDF
  • Article
  • Open access
  • Published: 10 March 2026

Synthetic data-driven deep learning for label-free autonomous atomic force microscopy

  • Ruben Millan-Solsona  ORCID: orcid.org/0000-0003-0912-72461,
  • Marti Checa  ORCID: orcid.org/0000-0003-2607-68661,
  • Spenser R. Brown2,
  • Amber N. Bible2,
  • Bernadeta Srijanto  ORCID: orcid.org/0000-0002-1188-12671,
  • Laura Wiggins3,
  • Sita Sirisha Madugula1,
  • Alice L. B. Pyne  ORCID: orcid.org/0000-0002-2658-89873,
  • Jennifer L. Morrell-Falvey2,
  • Scott Retterer  ORCID: orcid.org/0000-0001-8534-19791,2,
  • Rama K. Vasudevan  ORCID: orcid.org/0000-0003-4692-85791 &
  • …
  • Liam Collins1 

Nature Communications , Article number:  (2026) Cite this article

  • 2224 Accesses

  • 1 Altmetric

  • Metrics details

We are providing an unedited version of this manuscript to give early access to its findings. Before final publication, the manuscript will undergo further editing. Please note there may be errors present which affect the content, and all legal disclaimers apply.

Subjects

  • Applications of AFM
  • Characterization and analytical techniques
  • Nanostructures

Abstract

Atomic force microscopy (AFM) is a widely used tool for nanoscale characterization across materials science, energy research, and biology. However, its adoption in high-throughput materials discovery and statistically driven studies remains limited by a strong dependence on expert operator input and by the scarcity of annotated experimental AFM datasets needed to enable data-driven automation. Here, we introduce SimuScan, a synthetic-data–driven framework that enables reliable AFM feature identification, segmentation, and targeted imaging without requiring large manually labeled experimental datasets. SimuScan generates tunable, high-fidelity synthetic AFM images of defined morphologies while incorporating realistic experimental artifacts, including tip–sample convolution, noise, flattening distortions, and surface debris. These datasets are shown to support scalable, label-free training of modern deep learning models for AFM analysis. When integrated into data-driven AFM workflows, SimuScan-trained models can locate and analyze nanoscale structures across large datasets and guide targeted follow-up imaging. We validate this approach on nanostructured surfaces, DNA assemblies, and bacterial cells, demonstrating robust generalization across diverse sample types with minimal operator intervention. More broadly, this work establishes a general strategy for generating explicitly conditioned, task-relevant synthetic data to improve the reliability of downstream models in autonomous microscopy.

Similar content being viewed by others

Cross-scale high-bandwidth atomic force microscopy with a stick-slip nanopositioner

Article Open access 26 November 2025

A bi-channel aided stitching of atomic force microscopy images

Article Open access 25 November 2025

Deep learning-driven conversion of scanning superlens microscopy to high depth-of-field SEM-like imaging

Article Open access 19 December 2025

Data availability

The datasets and trained models generated in this study have been deposited in the Zenodo repository (https://zenodo.org/records/17037230 and https://zenodo.org/records/−17179726). All source data supporting the figures are provided with this paper.

Code availability

The analysis and training scripts are available on GitHub at https://github.com/Rmillansol/SimuScan-AFfMtools.git. A citable archived version of the code has been deposited in Zenodo (https://doi.org/10.5281/zenodo.18665434)53. The SimuScan synthetic data generator is distributed as a standalone command-line executable and is publicly available via Zenodo (https://zenodo.org/records/18134911), together with example configuration files and documentation.

References

  1. Binnig, G., Quate, C. F. & Gerber, C. Atomic force microscope. Phys. Rev. Lett. 56, 930 (1986).

    Google Scholar 

  2. Loos, J. The art of SPM: scanning probe microscopy in materials science. Adv. Mater. 17, 1821–1833 (2005).

    Google Scholar 

  3. Checa, M., Neumayer, S. M., Tsai, W. Y. & Collins, L. Advanced modes of electrostatic and kelvin probe force microscopy for energy applications. In Atomic Force Microscopy for Energy Research 45–104 (CRC Press, 2022).

  4. Dufrêne, Y. F. et al. Imaging modes of atomic force microscopy for application in molecular and cell biology. Nat. Nanotechnol. 12, 295–307 (2017).

    Google Scholar 

  5. Muzio, M. D., Millan-Solsona, R., Borrell, J. H., Fumagalli, L. & Gomila, G. Cholesterol effect on the specific capacitance of submicrometric DOPC bilayer patches measured by in-liquid scanning dielectric microscopy. Langmuir 36, 12963–12972 (2020).

    Google Scholar 

  6. Lozano, H. et al. Electrical properties of outer membrane extensions from Shewanella oneidensis MR-1. Nanoscale 13, 18754–18762 (2021).

    Google Scholar 

  7. Ahmad Khalili, A. & Ahmad, M. R. A review of cell adhesion studies for biomedical and biological applications. Int. J. Mol. Sci. 16, 18149–18184 (2015).

    Google Scholar 

  8. Checa, M., Millan-Solsona, R., Glinkowska Mares, A., Pujals, S. & Gomila, G. Dielectric imaging of fixed HeLa cells by in-liquid scanning dielectric force volume microscopy. Nanomaterials 11, 1402 (2021).

    Google Scholar 

  9. Collins, L. et al. Perspectives in scanning probe microscopy from the 2021 joint international scanning probe microscopy and scanning probe microscopy on soft and polymeric materials conference. Microsc. Anal. 57, 933709 (2021).

  10. Millan-Solsona, R. et al. Analysis of biofilm assembly by large area automated AFM. npj Biofilms Microbiomes 11, 75 (2025).

    Google Scholar 

  11. Kalinin, S. V. et al. Automated and autonomous experiments in electron and scanning probe microscopy. ACS Nano 15, 12604–12627 (2021).

    Google Scholar 

  12. Sadeghian, H. et al. Automated cantilever exchange and optical alignment for high-throughput parallel atomic force microscopy. IEEE/ASME Trans. Mechatron. 22, 2654–2661 (2017).

    Google Scholar 

  13. Yoo, R. Y. The story behind the first automatic atomic force microscope. Microsc. Today 30, 40–45 (2022).

    Google Scholar 

  14. Casuso, I. & Scheuring, S. Automated setpoint adjustment for biological contact mode atomic force microscopyimaging. Nanotechnology 21, 035104 (2009).

    Google Scholar 

  15. Liu, H. et al. Intelligent tuning method of PID parameters based on iterative learning control for atomic force microscopy. Micron 104, 26–36 (2018).

    Google Scholar 

  16. Abramovitch, D. Y., Hoen, S. & Workman, R. Semi-automatic tuning of PID gains for atomic force microscopes. In Proceedings of the 2008 American Control Conference 2684–2689 (IEEE, 2008).

  17. Zhou, X., Dong, X., Zhang, Y. & Fang, Y. Automatic tuning of PI controller for atomic force microscope based on relay with hysteresis. In Proceedings of the 2009 IEEE International Conference on Control Applications (CCA) & Intelligent Control (ISIC) 1271–1275 (IEEE, 2009).

  18. Liu, Y. et al. AEcroscopy: a software–hardware framework empowering microscopy toward automated and autonomous experimentation. Small Methods 8, 2301740 (2024).

    Google Scholar 

  19. Checa, M. et al. High-speed mapping of surface charge dynamics using sparse scanning Kelvin probe force microscopy. Nat. Commun. 14, 7196 (2023).

    Google Scholar 

  20. Degenhardt, J., Bounaim, M. W., Deng, N., Tutsch, R. & Dai, G. A new kind of atomic force microscopy scan control enabled by artificial intelligence: concept for achieving tip and sample safety through asymmetric control. Nanomanuf. Metrol. 7, 11 (2024).

    Google Scholar 

  21. Wei, Z. et al. A Novel Deep Reinforcement Learning Approach for Dynamic Proportional-Integral Control in Scanning Probe Microscopy. Small 21, e03921 (2025).

  22. Liu, Y. et al. Machine learning-based reward-driven tuning of scanning probe microscopy: toward fully automated microscopy. ACS Nano 19, 19659–19669 (2025).

    Google Scholar 

  23. Liu, Y. & Kalinin, S. V. Pareto-optimal experimentation: human-guided multi-objective bayesian optimization in scanning probe microscopy. Nano Lett. 26, 441–447 (2026).

  24. Paruchuri, A., Wang, Y., Gu, X. & Jayaraman, A. Machine learning for analyzing atomic force microscopy (AFM) images generated from polymer blends. Digital Discov. 3, 2533–2550 (2024).

    Google Scholar 

  25. Yablon, D. et al. Deep learning to establish structure property relationships of impact copolymers from AFM phase images. Mrs Commun. 11, 962–968 (2021).

    Google Scholar 

  26. Checa, M., Millan-Solsona, R., Mares, A. G., Pujals, S. & Gomila, G. Fast label-free nanoscale composition mapping of eukaryotic cells via scanning dielectric force volume microscopy and machine learning. Small Methods 5, 2100279 (2021).

    Google Scholar 

  27. Vasudevan, R. K. et al. Autonomous experiments in scanning probe microscopy and spectroscopy: choosing where to explore polarization dynamics in ferroelectrics. ACS Nano 15, 11253–11262 (2021).

    Google Scholar 

  28. Rade, J. et al. Deep learning for live cell shape detection and automated afm navigation. Bioengineering 9, 522 (2022).

    Google Scholar 

  29. Sotres, J., Boyd, H. & Gonzalez-Martinez, J. F. Enabling autonomous scanning probe microscopy imaging of single molecules with deep learning. Nanoscale 13, 9193–9203 (2021).

    Google Scholar 

  30. Huang, B., Li, Z. & Li, J. An artificial intelligence atomic force microscope enabled by machine learning. Nanoscale 10, 21320–21326 (2018).

    Google Scholar 

  31. Deng, J., Dong, W., Socher, R., Li, L. J., Li, K. & Fei-Fei, L. ImageNet: A large-scale hierarchical image database. In Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 248–255 (IEEE, 2009).

  32. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z. & Guo, B. Swin Transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) 10012–10022 (IEEE, 2021).

  33. Shorten, C. & Khoshgoftaar, T. M. A survey on image data augmentation for deep learning. J. Big Data 6, 1–48 (2019).

    Google Scholar 

  34. Nečas, D. & Klapetek, P. Synthetic data in quantitative scanning probe microscopy. Nanomaterials 11, 1746 (2021).

    Google Scholar 

  35. Klapetek, P. & Ohlı́dal, I. Theoretical analysis of the atomic force microscopy characterization of columnar thin films. Ultramicroscopy 94, 19–29 (2003).

  36. Klapetek, P., Ohlídal, I. & Bílek, J. Influence of the atomic force microscope tip on the multifractal analysis of rough surfaces. Ultramicroscopy 102, 51–59 (2004).

    Google Scholar 

  37. Klapetek, P., Valtr, M., Nečas, D., Salyk, O. & Dzik, P. Atomic force microscopy analysis of nanoparticles in non-ideal conditions. Nanoscale Res. Lett. 6, 514 (2011).

    Google Scholar 

  38. Chen, Y. Improving dimensional measurement from noisy atomic force microscopy images by non-local means filtering. Scanning 38, 113–120 (2016).

    Google Scholar 

  39. Wang, Y.-F. et al. Double-tip artifact removal from atomic force microscopy images. IEEE Trans. Image Process. 25, 2774–2788 (2016).

    Google Scholar 

  40. Argento, C. & French, R. Parametric tip model and force–distance relation for Hamaker constant determination from atomic force microscopy. J. Appl. Phys. 80, 6081–6090 (1996).

    Google Scholar 

  41. Niina, T., Fuchigami, S. & Takada, S. Flexible fitting of biomolecular structures to atomic force microscopy images via biased molecular simulations. J. Chem. Theory Comput. 16, 1349–1358 (2020).

    Google Scholar 

  42. Fuchigami, S., Niina, T. & Takada, S. Case report: Bayesian statistical inference of experimental parameters via biomolecular simulations: atomic force microscopy. Front. Mol. Biosci. 8, 636940 (2021).

    Google Scholar 

  43. Alldritt, B. et al. Automated structure discovery in atomic force microscopy. Sci. Adv. 6, eaay6913 (2020).

    Google Scholar 

  44. González Lastre, M. et al. Molecular identification via molecular fingerprint extraction from atomic force microscopy images. J. Cheminformatics 16, 130 (2024).

    Google Scholar 

  45. Beton, J. G. et al. TopoStats–A program for automated tracing of biomolecules from AFM images. Methods 193, 68–79 (2021).

    Google Scholar 

  46. Navarro, P. P. et al. Cell wall synthesis and remodelling dynamics determine division site architecture and cell shape in Escherichia coli. Nat. Microbiol. 7, 1621–1634 (2022).

    Google Scholar 

  47. Van Der Hofstadt, M. et al. Internal hydration properties of single bacterial endospores probed by electrostatic force microscopy. ACS Nano 10, 11327–11336 (2016).

    Google Scholar 

  48. Lithgow, T., Stubenrauch, C. J. & Stumpf, M. P. Surveying membrane landscapes: a new look at the bacterial cell surface. Nat. Rev. Microbiol. 21, 502–518 (2023).

    Google Scholar 

  49. Ultralytics YOLOv8, https://github.com/ultralytics/ultralytics (2023).

  50. Ronneberger, O., Fischer, P. & Brox, T. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015. 234–241 (Springer, 2015).

  51. He, K., Gkioxari, G., Dollár, P. & Girshick, R. Mask R-CNN. In Proceedings of the IEEE International Conference on Computer Vision (ICCV) 2961–2969 (IEEE, 2017).

  52. Pyne, A. L. et al. Base-pair resolution analysis of the effect of supercoiling on DNA flexibility and major groove recognition by triplex-forming oligonucleotides. Nat. Commun. 12, 1053 (2021).

    Google Scholar 

  53. Millan-Solsona, R. SimuScan-AFMtools (Version 1.0). Zenodo. https://doi.org/10.5281/zenodo.18665434 (2026).

Download references

Acknowledgements

This work was supported by the U.S. Department of Energy, Office of Science FWP ERKCZ64, Structure Guided Design of Materials to Optimize the Abiotic-Biotic Material Interface, as part of the the Biopreparedness Research Virtual Environment (BRaVE) initiative. AFM measurements, sample preparation, and image analysis were conducted as part of a user project at the Center for Nanophase Materials Sciences (CNMS), which is a US Department of Energy, Office of Science User Facility at Oak Ridge National Laboratory. We also acknowledge support from a UKRI Future Leaders Fellowship (MR/W00738X/1) and the Henry Royce Institute for Advanced Materials, funded through EPSRC grants EP/R00661X/1, EP/S019367/1, EP/P02470X/1 and EP/P025285/1 (A.L.B.P.). U.S. Department of Energy, Office of Science FWP ERKCZ64, Structure Guided Design of Materials to Optimize the Abiotic-Biotic Material Interface.

Author information

Authors and Affiliations

  1. Center for Nanophase Materials Sciences, Oak Ridge National Laboratory, Oak Ridge, TN, USA

    Ruben Millan-Solsona, Marti Checa, Bernadeta Srijanto, Sita Sirisha Madugula, Scott Retterer, Rama K. Vasudevan & Liam Collins

  2. Biosciences Division, Oak Ridge National Laboratory, Oak Ridge, TN, USA

    Spenser R. Brown, Amber N. Bible, Jennifer L. Morrell-Falvey & Scott Retterer

  3. School of Chemical, Materials and Biological Engineering, University of Sheffield, Sheffield, UK

    Laura Wiggins & Alice L. B. Pyne

Authors
  1. Ruben Millan-Solsona
    View author publications

    Search author on:PubMed Google Scholar

  2. Marti Checa
    View author publications

    Search author on:PubMed Google Scholar

  3. Spenser R. Brown
    View author publications

    Search author on:PubMed Google Scholar

  4. Amber N. Bible
    View author publications

    Search author on:PubMed Google Scholar

  5. Bernadeta Srijanto
    View author publications

    Search author on:PubMed Google Scholar

  6. Laura Wiggins
    View author publications

    Search author on:PubMed Google Scholar

  7. Sita Sirisha Madugula
    View author publications

    Search author on:PubMed Google Scholar

  8. Alice L. B. Pyne
    View author publications

    Search author on:PubMed Google Scholar

  9. Jennifer L. Morrell-Falvey
    View author publications

    Search author on:PubMed Google Scholar

  10. Scott Retterer
    View author publications

    Search author on:PubMed Google Scholar

  11. Rama K. Vasudevan
    View author publications

    Search author on:PubMed Google Scholar

  12. Liam Collins
    View author publications

    Search author on:PubMed Google Scholar

Contributions

R.M.-S. and L.C. conceived the study (Conceptualization) and developed the methodology. R.M.-S. led the software development, while validation and formal analysis was assisted by M.C., S.S.M., R.K.V., and L.C. Experimental investigation was performed by R.M.-S. Resources were provided by S.R.B., B.S., A.N.B., J.L.M.-F., A.P., and L.W. Data curation was handled by R.M.-S., M.C., and L.C. Data visualization was conducted by R.M.-S., M.C., and L.C. L.C. supervised and administered the project. The original draft was written by L.C. and R.M.-S., and all authors reviewed and edited the manuscript. Funding was acquired by L.C. and S.R.

Corresponding authors

Correspondence to Ruben Millan-Solsona or Liam Collins.

Ethics declarations

Competing interests

The authors declare no competing interests.

Peer review

Peer review information

Nature Communications thanks Philippe Leclere and the other, anonymous, reviewer(s) for their contribution to the peer review of this work. A peer review file is available.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Supplementary Information (download PDF )

Description of Additional Supplementary Files (download PDF )

Supplementary Movie 1 (download MP4 )

Supplementary Movie 2 (download MP4 )

Transparent Peer Review file (download PDF )

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Millan-Solsona, R., Checa, M., Brown, S.R. et al. Synthetic data-driven deep learning for label-free autonomous atomic force microscopy. Nat Commun (2026). https://doi.org/10.1038/s41467-026-70421-3

Download citation

  • Received: 26 September 2025

  • Accepted: 26 February 2026

  • Published: 10 March 2026

  • DOI: https://doi.org/10.1038/s41467-026-70421-3

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Download PDF

Advertisement

Explore content

  • Research articles
  • Reviews & Analysis
  • News & Comment
  • Videos
  • Collections
  • Subjects
  • Follow us on Facebook
  • Follow us on X
  • Sign up for alerts
  • RSS feed

About the journal

  • Aims & Scope
  • Editors
  • Journal Information
  • Open Access Fees and Funding
  • Calls for Papers
  • Editorial Values Statement
  • Journal Metrics
  • Editors' Highlights
  • Contact
  • Editorial policies
  • Top Articles

Publish with us

  • For authors
  • For Reviewers
  • Language editing services
  • Open access funding
  • Submit manuscript

Search

Advanced search

Quick links

  • Explore articles by subject
  • Find a job
  • Guide to authors
  • Editorial policies

Nature Communications (Nat Commun)

ISSN 2041-1723 (online)

nature.com footer links

About Nature Portfolio

  • About us
  • Press releases
  • Press office
  • Contact us

Discover content

  • Journals A-Z
  • Articles by subject
  • protocols.io
  • Nature Index

Publishing policies

  • Nature portfolio policies
  • Open access

Author & Researcher services

  • Reprints & permissions
  • Research data
  • Language editing
  • Scientific editing
  • Nature Masterclasses
  • Research Solutions

Libraries & institutions

  • Librarian service & tools
  • Librarian portal
  • Open research
  • Recommend to library

Advertising & partnerships

  • Advertising
  • Partnerships & Services
  • Media kits
  • Branded content

Professional development

  • Nature Awards
  • Nature Careers
  • Nature Conferences

Regional websites

  • Nature Africa
  • Nature China
  • Nature India
  • Nature Japan
  • Nature Middle East
  • Privacy Policy
  • Use of cookies
  • Legal notice
  • Accessibility statement
  • Terms & Conditions
  • Your US state privacy rights
Springer Nature

© 2026 Springer Nature Limited

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing