Reproducibility in Management Science

Published Online:https://doi.org/10.1287/mnsc.2023.03556

References

  • Ankel-Peters J, Fiala N, Neubauer F (2023) Do economists replicate? J. Econom. Behav. Organ. 212:219–232.CrossrefGoogle Scholar
  • Artner R, Verliefde T, Steegen S, Gomes S, Traets F, Tuerlinckx F, Vanpaemel W (2021) The reproducibility of statistical results in psychological research: An investigation using unpublished raw data. Psych. Methods 26(5):527–546.CrossrefGoogle Scholar
  • Brodeur A, Lé M, Sangnier M, Zylberberg Y (2016) Star wars: The empirics strike back. Amer. Econom. J. Appl. Econom. 8(1):1–32.CrossrefGoogle Scholar
  • Camerer CF, Dreber A, Forsell E, Ho TH, Huber J, Johannesson M, Kirchler M, et al. (2016) Evaluating replicability of laboratory experiments in economics. Science 351(6280):1433–1436.CrossrefGoogle Scholar
  • Camerer CF, Dreber A, Holzmeister F, Ho TH, Huber J, Johannesson M, Kirchler M, et al. (2018) Evaluating the replicability of social science experiments in nature and science between 2010 and 2015. Nature Human Behav. 2(9):637–644.CrossrefGoogle Scholar
  • Chang AC, Li P (2017) A preanalysis plan to replicate sixty economics research papers that worked half of the time. Amer. Econom. Rev. 107(5):60–64.CrossrefGoogle Scholar
  • Christensen G, Miguel E (2018) Transparency, reproducibility, and the credibility of economics research. J. Econom. Literature 56(3):920–980.CrossrefGoogle Scholar
  • Clemens MA (2017) The meaning of failed replications: A review and proposal. J. Econom. Survey 31(1):326–342.CrossrefGoogle Scholar
  • Colliard J-E, Hurlin C, Pérignon C (2023) The economics of computational reproducibility. Research Paper No. FIN-2019-1345, HEC Paris, Paris.Google Scholar
  • Davis AM, Flicker B, Hyndman KB, Katok E, Keppler S, Leider S, Long X, et al. (2023) A replication study of operations management experiments in Management Science. Management Sci. 69(9):4977–4991.LinkGoogle Scholar
  • De Long JB, Lang K (1992) Are all economic hypotheses false? J. Political Econom. 100(6):1257–1272.CrossrefGoogle Scholar
  • Dewald WG, Thursby JG, Anderson RG (1986) Replication in empirical economics: The journal of money, credit and banking project. Amer. Econom. Rev. 76(4):587–603.Google Scholar
  • Dreber A, Johannesson M (2023) A framework for evaluating reproducibility and replicability in economics. Working paper, Stockholm School of Economics, Stockholm.Google Scholar
  • Eubank N (2016) Lessons from a decade of replications at the quarterly journal of political science. PS Political Sci. Politics 49(2):273–276.CrossrefGoogle Scholar
  • Freese J, Peterson D (2017) Replication in social science. Annu. Rev. Sociol. 43:147–165.CrossrefGoogle Scholar
  • Gertler P, Galiani S, Romero M (2018) How to make replication the norm. Nature 554(7693):417–419.CrossrefGoogle Scholar
  • Glandon PJ (2011) Appendix to the report of the editor: Report on the american economic review data availability compliance project. Amer. Econom. Rev. 101(3):695–699.Google Scholar
  • Hamermesh DS (2007) Replication in economics. Canadian J. Econom. 40(3):715–733.CrossrefGoogle Scholar
  • Herbert S, Kingi H, Stanchi F, Vilhuber L (2023) The reproducibility of economics research: A case study. Working paper, Banque de France, Paris.Google Scholar
  • Höffler JH (2017) Replication and economics journal policies. Amer. Econom. Rev. 107(5):52–55.CrossrefGoogle Scholar
  • Hornik K (2005) A clue for cluster ensembles. J. Statist. Software 14:1–25.CrossrefGoogle Scholar
  • Ioannidis JP (2005) Why most published research findings are false. PLoS Medicine 2(8):e124.CrossrefGoogle Scholar
  • Ioannidis JP, Doucouliagos C (2013) What’s to know about the credibility of empirical economics? J. Econom. Survey 27(5):997–1004.CrossrefGoogle Scholar
  • Ioannidis JP, Allison DB, Ball CA, Coulibaly I, Cui X, Culhane AC, Falchi M, et al. (2009) Repeatability of published microarray gene expression analyses. Nature Genetics 41(2):149–155.CrossrefGoogle Scholar
  • John LK, Loewenstein G, Prelec D (2012) Measuring the prevalence of questionable research practices with incentives for truth telling. Psych. Sci. 23(5):524–532.CrossrefGoogle Scholar
  • Kuhn HW (1955) The Hungarian method for the assignment problem. Naval Res. Logist. Quart. 2:83–97.CrossrefGoogle Scholar
  • List JA, Bailey CD, Euzent PJ, Martin TL (2001) Academic economists behaving badly? A survey on three areas of unethical behavior. Econom. Inquiry 39(1):162–170.CrossrefGoogle Scholar
  • McCullough BD, McGeary KA, Harrison TD (2006) Lessons from the JMCB archive. J. Money Credit Bank. 38(4):1093–1107.CrossrefGoogle Scholar
  • McCullough BD, McGeary KA, Harrison TD (2008) Do economics journal archives promote replicable research? Canadian J. Econom. 41(4):1406–1420.CrossrefGoogle Scholar
  • Menkveld AJ, Dreber A, Holzmeister F, Huber J, Johannesson M, Kirchler M, Neusüss S, et al. (2023) Non-standard errors. J. Finance. Forthcoming.Google Scholar
  • Nagel S (2018) Code-sharing policy: Update. Journal of Finance Editor Blog (March 6), https://voices.uchicago.edu/jfeditor/2018/03/06/code-sharing-policy-update.Google Scholar
  • Naudet F, Sakarovitch C, Janiaud P, Cristea I, Fanelli D, Moher D, Ioannidis JP (2018) Data sharing and reanalysis of randomized controlled trials in leading biomedical journals with a full data sharing policy: Survey of studies published in the BMJ and PLOS Medicine. BMJ 218:360.Google Scholar
  • Nosek BA, Spies JR, Motyl M (2012) Scientific utopia: II. Restructuring incentives and practices to promote truth over publishability. Perspective Psych. Sci. 7(6):615–631.CrossrefGoogle Scholar
  • Open Science Collaboration (2015) Estimating the reproducibility of psychological science. Science 349(6251):aac4716.CrossrefGoogle Scholar
  • Pérignon C, Gadouche K, Hurlin C, Silberman R, Debonnel E (2019) Certify reproducibility with confidential data. Science 365(6449):127–128.CrossrefGoogle Scholar
  • Pérignon C, Akmansoy O, Hurlin C, Dreber A, Holzmeister F, Huber J, Johannesson M, et al. (2023) Computational reproducibility in finance: Evidence from 1,000 tests. Working paper, HEC Paris Research Paper, Paris.Google Scholar
  • Simmons JP, Nelson LD, Simonsohn U (2011) False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psych. Sci. 22(11):1359–1366.CrossrefGoogle Scholar
  • Uhlmann EL, Ebersole CR, Chartier CR, Errington TM, Kidwell MC, Lai CK, McCarthy RJ, et al. (2019) Scientific utopia III: Crowdsourcing science. Perspective Psych. Sci. 14(5):711–733.CrossrefGoogle Scholar
  • Vilhuber L (2019) Report by the AEA data editor. Amer. Econom. Rev. 109:718–729.Google Scholar
  • Vlaeminck S (2021) Dawning of a new age? Economics journals’ data policies on the test bench. LIBER Quart. J. Assoc. Eur. Res. Libraries 31(1):1–29.CrossrefGoogle Scholar
  • Welch I (2019) Reproducing, extending, updating, replicating, reexamining, and reconciling. Critical Finance Rev. 8(1–2):301–304.CrossrefGoogle Scholar
  • Xiong X, Cribben I (2023) The state of play of reproducibility in statistics: An empirical analysis. Amer. Statist. 77(2):115–126.CrossrefGoogle Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.