Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Comment
  • Published:

Introducing synchronous robustness reports

Most empirical research articles feature a single primary analysis that is conducted by the authors. However, different analysis teams usually adopt different analytical approaches and frequently reach varied conclusions. We propose synchronous robustness reports — brief reports that summarize the results of alternative analyses by independent experts — to strengthen the credibility of science.

This is a preview of subscription content, access via your institution

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: COVID-19 R estimates from nine expert teams.
Fig. 2: Integrating SRRs into the publication process.

References

  1. Scientific Pandemic Influenza Group on Modelling. SPI-M-O: Consensus Statement on COVID-19, 8 October 2020 (2020).

  2. Wagenmakers, E.-J., Sarafoglou, A. & Aczel, B. Nature 605, 423–425 (2022).

    Article  CAS  PubMed  Google Scholar 

  3. Botvinik-Nezer, R. et al. Nature 582, 84–88 (2020).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Silberzahn, R. et al. Adv. Methods Pract. Psychol. Sci. 1, 337–356 (2018).

    Article  Google Scholar 

  5. Breznau, N. et al. Proc. Natl Acad. Sci. USA 119, e2203150119 (2022).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Bastiaansen, J. A. et al. J. Psychosom. Res. 137, 110211 (2020).

    Article  PubMed  PubMed Central  Google Scholar 

  7. Menkveld, A. J. et al. J. Finance 79, 2339–2390 (2023).

    Article  Google Scholar 

  8. Wagenmakers, E.-J. & Bartoš, F. Preprint at PsyArXiv https://doi.org/10.31234/osf.io/2u84v (2025).

  9. Sarafoglou, A. Preprint at PsyArXiv https://doi.org/10.31234/osf.io/6je5r (2025).

  10. Hoogeveen, S. Preprint at PsyArXiv https://doi.org/10.31234/osf.io/sy5n8 (2025).

  11. Nosek, B. A. et al. Science 348, 1422–1425 (2015).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Brodeur, A., Dreber, A., Hoces de la Guardia, F. & Miguel, E. Nat. Hum. Behav. 8, 2–3 (2024).

    Article  PubMed  Google Scholar 

  13. Nat. Hum. Behav. 8, 1 (2024).

  14. Wilkinson, M. D. et al. Sci. Data 3, 160018 (2016).

    Article  PubMed  PubMed Central  Google Scholar 

  15. Hardwicke, T. E. & Wagenmakers, E.-J. Nat. Hum. Behav. 7, 15–26 (2023).

    Article  PubMed  Google Scholar 

  16. Chambers, C. D. Cortex 49, 609–610 (2013).

    Article  PubMed  Google Scholar 

  17. Dutilh, G., Sarafoglou, A. & Wagenmakers, E.-J. Synthese 198 (Suppl. 23), 5745–5772 (2021).

    Article  Google Scholar 

  18. Aczel, B. et al. eLife 10, e72185 (2021).

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors were supported in part by an NWO Open Science grant (OSF23.1.030) and a 2024 Ammodo Science Award.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to František Bartoš.

Ethics declarations

Competing interests

F.B., A.S. and E.-J.W. declare their involvement in the open-source software package JASP (jasp-stats.org), a non-commercial, publicly funded effort to make both Bayesian and classical statistics accessible to a broader group of researchers and students. The other authors declare no competing interests.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bartoš, F., Sarafoglou, A., Aczel, B. et al. Introducing synchronous robustness reports. Nat Hum Behav 9, 635–637 (2025). https://doi.org/10.1038/s41562-025-02129-1

Download citation

  • Published:

  • Issue date:

  • DOI: https://doi.org/10.1038/s41562-025-02129-1

Search

Quick links

Nature Briefing Careers

Sign up for the Nature Briefing: Careers newsletter — what matters in careers research, free to your inbox weekly.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing: Careers