Thinking Beyond RVCN: Addressing the Complexity of Replication Target Selection
DOI:
https://doi.org/10.15626/MP.2024.4323Keywords:
replication target selection, qualitative frameworksAbstract
Isager, van ’t Veer and Lakens (2025) proposed a quantitative operationalization of replication value (denoted RVCN), using average yearly citation count and sample size as proxies for value and uncertainty, respectively. In this commentary, we suggest that the approach of Isager et al., while a good theoretical departure point, oversimplifies the complex decision-making process that underpins replication target selection in practice. We present what we view as some issues with RVCN, notably the use of citation count and ambiguity as to whether RVCN is prescriptive or descriptive. We also present preliminary empirical evidence that RVCN diverges on its performance as a replication target selection method, compared with existing selection methods (such as those published by us in the past). We conclude with the recommendation that going forward, approaches should emphasize the multifaceted nature of replication target selection to maximize their practical utility.
Metrics
References
Field, S. M., Hoekstra, R., Bringmann, L., & van Ravenzwaaij, D. (2019). When and Why to Replicate: As Easy as 1, 2, 3? Collabra: Psychology, 5(1), 46. https://doi.org/10.1525/collabra.218
Isager, P. M., van’t Veer, A. E., & Lakens, D. (2025). Replication value as a function of citation impact and sample size. Meta-Psychology, 9. https://doi.org/10.15626/MP.2022.3300
Patience, G. S., Patience, C. A., Blais, B., & Bertrand, F. (2017). Citation analysis of scientific categories. Heliyon, 3(5), e00300. https://doi.org/10.1016/j.heliyon.2017.e00300
Pittelkow, M.-M., Field, S. M., Isager, P. M., van’t Veer, A. E., Anderson, T., Cole, S. N., Dominik, T., Giner-Sorolla, R., Gok, S., Heyman, T., Jekel, M., Luke, T. J., Mitchell, D. B., Peels, R., Pendrous, R., Sarrazin, S., Schauer, J. M., Specker, E., Tran, U. S., . . . van Ravenzwaaij, D. (2023). The process of replication target selection in psychology: What to consider? [Publisher: Royal Society]. Royal Society Open Science, 10(2), 210586. https://doi.org/10.1098/rsos.210586
Pittelkow, M.-M., Hoekstra, R., Karsten, J., & van Ravenzwaaij, D. (2021). Replication target selection in clinical psychology: A Bayesian and qualitative reevaluation. Clinical Psychology: Science and Practice, 28(2), 210–221. https://doi.org/10.1037/CPS0000013
Published
Issue
Section
License
Copyright (c) 2025 Merle-Marie Pittelkow, Sarahanne M. Field, Don van Ravenzwaaij
This work is licensed under a Creative Commons Attribution 4.0 International License.
