Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Correspondence
  • Published:

Clarifying the terminology that describes scientific reproducibility

Nature Methods volume 12, page 699 (2015)Cite this article

Subjects

To the Editor

There has recently been a growing interest in discussions of reproducible/repeatable scientific research1,2. The scientific press appears to be witnessing a confusion of terms: reproducibility, repeatability and replicability are referred to with different and sometimes conflicting meanings, both between and within fields. We suggest that these terms can be clarified by considering the intended generalization of the study at hand.

This is a preview of subscription content, access via your institution

Access options

Buy this article

  • Purchase on SpringerLink
  • Instant access to the full article PDF.

USD 39.95

Prices may be subject to local taxes which are calculated during checkout

References

  1. McNutt, M. Science 343, 229 (2014).

    Article  CAS  Google Scholar 

  2. Banks, D. Stat. Politics Policy 2, 10.2202/2151-7509.1023 (2011).

  3. Kenett, R.S., Zacks, S. & Amberti, D. Modern Industrial Statistics: With Applications in R, MINITAB and JMP 2nd edn. (Wiley, 2014).

    Google Scholar 

  4. Ionnides, J.P. et al. Nat. Genet. 41, 149–155 (2009).

    Article  Google Scholar 

  5. Drummond, C., Japkowicz, N., Klement, W. & Macskassy, S.A. in Proc. 26th. Int. Conf. Mach. Learn. 10.1145/1553374.1553546 (ACM, 2009).

    Google Scholar 

  6. Kenett, R.S. & Shmueli, G. J. R. Stat. Soc. Ser. A Stat. Soc. 177, 3–38 (2014).

    Article  Google Scholar 

  7. Richter, S.H., Garner, J.P. & Würbel, H. Nat. Methods 6, 257–261 (2009).

    Article  CAS  Google Scholar 

  8. Richter, S.H., Garner, J.P., Auer, C., Kunert, J. & Würbel, H. Nat. Methods 7, 167–168 (2010).

    Article  CAS  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Turin, Turin, Italy

    Ron S Kenett

  2. The KPA Group, Raanana, Israel

    Ron S Kenett

  3. Institute of Service Science, National Tsing Hua University, Hsinchu, Taiwan

    Galit Shmueli

Authors
  1. Ron S Kenett
    View author publications

    Search author on:PubMed Google Scholar

  2. Galit Shmueli
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Ron S Kenett.

Ethics declarations

Competing interests

The authors declare no competing financial interests.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kenett, R., Shmueli, G. Clarifying the terminology that describes scientific reproducibility. Nat Methods 12, 699 (2015). https://doi.org/10.1038/nmeth.3489

Download citation

  • Published:

  • Issue date:

  • DOI: https://doi.org/10.1038/nmeth.3489

This article is cited by

Search

Advanced search

Quick links

Nature Briefing Careers

Sign up for the Nature Briefing: Careers newsletter — what matters in careers research, free to your inbox weekly.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing: Careers