Footprint of publication selection bias on meta-analyses in medicine, environmental sciences, psychology, and economics

0585138 - ÚI 2025 US eng J - Článek v odborném periodiku
Bartoš, František - Maier, M. - Wagenmakers, J. E. - Nippold, F. - Doucouliagos, H. - Ioannidis, J. P. A. - Otte, W. M. - Sladekova, M. - Deresssa, T. K. - Bruns, S. B. - Fanelli, D. - Stanley, T. D.
Footprint of publication selection bias on meta-analyses in medicine, environmental sciences, psychology, and economics.
Research Synthesis Methods. Online 07 February 2024 (2024). ISSN 1759-2879. E-ISSN 1759-2887
Institucionální podpora: RVO:67985807
Klíčová slova: Bayesian * effect sizes * evidence * meta-analysis * model-averaging * publication bias * RoBMA
Obor OECD: Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)
Impakt faktor: 9.8, rok: 2022
Způsob publikování: Open access
https://doi.org/10.1002/jrsm.1703

Publication selection bias undermines the systematic accumulation of evidence. To assess the extent of this problem, we survey over 68,000 meta-analyses containing over 700,000 effect size estimates from medicine (67,386/597,699), environmental sciences (199/12,707), psychology (605/23,563), and economics (327/91,421). Our results indicate that meta-analyses in economics are the most severely contaminated by publication selection bias, closely followed by meta-analyses in environmental sciences and psychology, whereas meta-analyses in medicine are contaminated the least. After adjusting for publication selection bias, the median probability of the presence of an effect decreased from 99.9% to 29.7% in economics, from 98.9% to 55.7% in psychology, from 99.8% to 70.7% in environmental sciences, and from 38.0% to 29.7% in medicine. The median absolute effect sizes (in terms of standardized mean differences) decreased from d = 0.20 to d = 0.07 in economics, from d = 0.37 to d = 0.26 in psychology, from d = 0.62 to d = 0.43 in environmental sciences, and from d = 0.24 to d = 0.13 in medicine.
Trvalý link: https://hdl.handle.net/11104/0352876