Pre-replication: Anything Goes, Once
DOI:
https://doi.org/10.15626/MP.2024.4155Keywords:
axiology, epistemology, methodologyAbstract
In this commentary, we propose pre-replication as a necessary epistemic, analytic, and axiologic exercise to be carried out before each replication.
Metrics
References
Altman, D. G. (1994). The scandal of poor medical research. BMJ, 308(6924), 283–284. https://doi.org/10.1136/bmj.308.6924.283
Buzbas, E. O., & Devezer, B. (2023). Tension between theory and practice of replication. Journal of Trial & Error, 4(1). https://doi.org/10.36850/mr9
Buzbas, E. O., & Devezer, B. (2024). Statistics in service of metascience: Measuring replication distance with reproducibility rate. Entropy, 26(10), 842.
Chambers, C. (2017). The seven deadly sins of psychology: A manifesto for reforming the culture of scientific practice. Princeton University Press.
Dienes, Z. (2023). The pragmatics of statistical inference. In D. Trafimow (Ed.), Research handbook on the replication crisis. Edward Elgar Publishing, Inc.
Freedman, B. (1987). Scientific value and validity as ethical requirements for research: A proposed explication. IRB: Ethics & Human Research, 9(6), 7–10. https://doi.org/10.2307/3563623
Giles, J. (2006). The trouble with replication. Nature, 442(7101), 344–348. https://doi.org/10.1038/442344a
Isager, P. M., Van Aert, R., Bahník, Š., Brandt, M. J., DeSoto, K. A., Giner-Sorolla, R., Lakens, D., et al. (2023). Deciding what to replicate: A decision model for replication study selection under resource and knowledge constraints. Psychological Methods, 28(2), 438. https://doi.org/10.1037/met0000438
Jaeschke, R., Singer, J., & Guyatt, G. H. (1989). Measurement of health status: Ascertaining the minimal clinically important difference. Controlled clinical trials, 10(4), 407–415. https://doi.org/10.1016/0197-2456(89)90005-6
Karhulahti, V. M. (2024). Positionality statements in science. Open Research Europe, 4, 62. https://doi.org/10.12688/openreseurope.17058.2
Longino, H. E. (2002). The fate of knowledge. Princeton University Press.
Martonˇcik, M., Babjáková, J., ˇCupková, L., Köverová, N., & Kaˇcmárová, M. (2020). Simulation of vocational activities: Experimental evidence of (no) changes in vocational interests. Empirical Research in Vocational Education and Training, 12(1). https://doi.org/10.1186/s40461-020-00093-w
McGlothlin, A. E., & Lewis, R. J. (2014). Minimal clinically important difference: Defining what really matters to patients. JAMA, 312(13), 1342–1343. https://doi.org/10.1001/jama.2014.13128
Merton, R. K. (1973). The sociology of science: Theoretical and empirical investigations. The University of Chicago Press.
Ng, K., Kaskinen, A. P., Katila, R., Koski, P., & Karhulahti, V. M. (2022). Associations between sports videogames and physical activity in children. Physical Culture and Sport. Studies and Research, 95(1), 68–75. https://doi.org/10.2478/pcssr-2022-0012
Nosek, B. A., & Errington, T. M. (2020). What is replication? PLoS biology, 18(3), e3000691. https://doi.org/10.1371/journal.pbio.3000691
Rajˇcáni, J., Vargová, L., Adamkoviˇc, M., & Kaˇcmár, P. (2023). Statistical misconceptions, awareness, and attitudes towards open science practices in Slovak psychology researchers. Studia Psychologica, 65(1), 56–70. https ://doi.org/10.31577/sp.2023.01.866
Rotello, C. M., Heit, E., & Dubé, C. (2015). When more data steer us wrong: Replications with the wrong dependent measure perpetuate erroneous conclusions. Psychonomic Bulletin & Review, 22, 944–954. https://doi.org/10.3758/s13423-014-0759-2
Scheel, A. M. (2022). Why most psychological research findings are not even wrong. Infant and Child Development, 31(1), e2295. https://doi.org/10.1002/icd.2295
Weinberg, A. M. (1970). The axiology of science: The urgent question of scientific priorities has helped to promote a growing concern with value in science. American Scientist, 58(6), 612–617.
White, N., & Barnett, A. (2025). Appropriate statistical methods are necessary for ethical medical research. BMJ, 388, r3. https://doi.org/10.1136/bmj.r3
Zarin, D. A., Goodman, S. N., & Kimmelman, J. (2019). Harms from uninformative clinical trials. JAMA, 322(9), 813–814. https://doi.org/10.1001/jama.2019.9892
Published
Issue
Section
License
Copyright (c) 2025 Veli-Matti Karhulahti, Marcel Martončik, Matúš Adamkovič
This work is licensed under a Creative Commons Attribution 4.0 International License.
