Replication Value Increases With Transparency, Test Severity, and Societal Impact

Rene Bekkers

doi:10.15626/MP.2024.4194

Downloads

PDF

Authors

Rene Bekkers VU Amsterdam

DOI:

https://doi.org/10.15626/MP.2024.4194

Keywords:

citation count, replication, replication value, RVcn, sample size, study selection

Abstract

This comment argues that replications should not be prioritized as a function of citation count and sample size, but instead as a function of societal impact, test severity, and the information value of a replication.

Metrics

Metrics Loading ...

References

Bornmann, L., & Daniel, H. D. (2008). What do citation counts measure? a review of studies on citing behavior. Journal of Documentation, 64(1), 45–80. https://doi.org/10.1108/00220410810844150

Feynman, R. P. (1974). Cargo cult science: Some remarks on science, pseudoscience, and learning how not to fool yourself.

Harden, K. P. (2021). “reports of my death were greatly exaggerated”: Behavior genetics in the postgenomic era. Annual Review of Psychology, 72, 37–60. https://doi.org/10.1146/annurev- psych-052220-103822

Isager, P., van ’t Veer, A., & Lakens, D. (2025). Replication value as a function of citation impact and sample size. Meta-Psychology, 9. https://doi.org/10.15626/MP.2022.3300

Meursinge Reynders, R. A., Cavagnetto, D., ter Riet, G., Di Girolamo, N., & Malicki, M. (2024). Automatically listing senior members of departments as co-authors is highly prevalent in health sciences: Meta-analysis of survey research. Scientific Reports, 14, 5883. https://doi.org/10.1038/s41598-024-55966-x

Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science,349, aac4716. https://doi.org/10.1126/science.aac4716

Popper, K. R. (1972). Objective knowledge: An evolutionary approach. Oxford University Press.

Scheel, A. M., Schijen, M. R., & Lakens, D. (2021). An excess of positive results: Comparing the standard psychology literature with registered reports. Advances in Methods and Practices in Psychological Science, 4(2). https://doi.org/10.1177/25152459211007467

Serra-Garcia, M., & Gneezy, U. (2021). Nonreplicable publications are cited more than replicable ones. Science Advances, 7(21), eabd1705. https://doi.org/10.1126/sciadv.abd1705

Wilhite, A. W., & Fong, E. A. (2012). Coercive citation in academic publishing. Science, 335(6068), 542–543. https://doi.org/10.1126/science.1212540