The Credibility Gap
Evaluating and Improving Empirical Research in the Social Sciences
Seiten
2025
Routledge (Verlag)
978-1-032-94289-6 (ISBN)
Routledge (Verlag)
978-1-032-94289-6 (ISBN)
- Noch nicht erschienen (ca. April 2025)
- Versandkostenfrei
- Auch auf Rechnung
- Artikel merken
Which scientific results can we trust? This question has been brought to the forefront of research in the social sciences in recent years with the movement towards open science practices and pre-registration. Systematic replication studies of laboratory experiments in the social sciences have found that only about half of the “statistically significant” results published in top journals can be replicated in the sense that similar results are achieved with new data. This low replicability may be even lower in studies based on observational data as such studies have more degrees of freedom in the analysis of the data leading to larger possibilities to selectively report more publishable findings.
In this book, the authors provide a framework for evaluating reproducibility, replicability and generalizability of empirical research in the social sciences. They define different types of reproducibility and replicability and show how they can be measured to evaluate the credibility of published findings. Different approaches to improving the credibility of published findings, such as preregistration with detailed pre-analysis plans, Registered Report publications, and preregistered prospective meta-analysis are also outlined and discussed. Even if published results are not systematically biased, the variation in results across populations, research designs, and analyses decreases the reliability and generalizability of published findings. The book shows how such heterogeneity in results can be measured and incorporated in the analysis to more accurately represent the uncertainty and thereby generalizability of reported results.
In this book, the authors provide a framework for evaluating reproducibility, replicability and generalizability of empirical research in the social sciences. They define different types of reproducibility and replicability and show how they can be measured to evaluate the credibility of published findings. Different approaches to improving the credibility of published findings, such as preregistration with detailed pre-analysis plans, Registered Report publications, and preregistered prospective meta-analysis are also outlined and discussed. Even if published results are not systematically biased, the variation in results across populations, research designs, and analyses decreases the reliability and generalizability of published findings. The book shows how such heterogeneity in results can be measured and incorporated in the analysis to more accurately represent the uncertainty and thereby generalizability of reported results.
Anna Dreber is Professor of economics at the Stockholm School of Economics, Sweden. Magnus Johannesson is Professor of economics at the Stockholm School of Economics, Sweden.
1. Introduction 2. p-values, power and p-hacking 3. Pre-registration 4. A framework for evaluating reproducibility and replicability 5. Results from large-scale reproducibility studies 6. Results from large-scale replicability studies 7. Predicting replications 8. A framework for evaluating heterogeneity and generalizability 9. Empirical estimates of heterogeneity 10. Meta-analysis and aggregating research findings 11. Debugging observational data studies 12. Conclusion
| Erscheint lt. Verlag | 17.4.2025 |
|---|---|
| Zusatzinfo | 13 Tables, black and white; 15 Line drawings, color; 15 Illustrations, color |
| Verlagsort | London |
| Sprache | englisch |
| Maße | 156 x 234 mm |
| Themenwelt | Mathematik / Informatik ► Mathematik ► Angewandte Mathematik |
| Wirtschaft ► Allgemeines / Lexika | |
| Wirtschaft ► Volkswirtschaftslehre | |
| ISBN-10 | 1-032-94289-4 / 1032942894 |
| ISBN-13 | 978-1-032-94289-6 / 9781032942896 |
| Zustand | Neuware |
| Haben Sie eine Frage zum Produkt? |
Mehr entdecken
aus dem Bereich
aus dem Bereich
Buch | Softcover (2024)
Springer Vieweg (Verlag)
CHF 62,95
Anwendungen und Theorie von Funktionen, Distributionen und Tensoren
Buch | Softcover (2023)
De Gruyter Oldenbourg (Verlag)
CHF 97,90
