Do t-Statistic Hurdles Need to Be Raised?

References

• Allison DB, Gadbury GL, Heo M, Fernández JR, Lee CK, Prolla TA, Weindruch R (2002) A mixture model approach for the analysis of microarray gene expression data. Comput. Statist. Data Anal. 39:1–20.Crossref, Google Scholar
• Andrews I, Kasy M (2019) Identification of and correction for publication bias. Amer. Econom. Rev. 109:2766–2794.Crossref, Google Scholar
• Barberis N (2018) Psychology-based models of asset prices and trading volume. Handbook of Behavioral Economics: Applications and Foundations 1, vol. 1 (Elsevier, New York), 79–175.Crossref, Google Scholar
• Benjamin DJ, Berger JO, Johannesson M, Nosek BA, Wagenmakers EJ, Berk R, Bollen KA, et al. (2018) Redefine statistical significance. Nature Human Behav. 2:6.Crossref, Google Scholar
• Benjamini Y (2010) Discovering the false discovery rate. J. Roy. Statist. Soc. B 72:405–416.Crossref, Google Scholar
• Benjamini Y (2020) Selective inference: The silent killer of replicability. Harvard Data Sci. Rev. (December 16), https://hdsr.mitpress.mit.edu/pub/l39rpgyc/release/3.Crossref, Google Scholar
• Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. Roy. Statist. Soc. B 57(1):289–300.Crossref, Google Scholar
• Benjamini Y, Hochberg Y (2000) On the adaptive control of the false discovery rate in multiple testing with independent statistics. J. Ed. Behav. Statist. 25:60–83.Crossref, Google Scholar
• Benjamini Y, Yekutieli D (2001) The control of the false discovery rate in multiple testing under dependency. Ann. Statist. 29(4):1165–1188.Google Scholar
• Benjamini Y, Krieger AM, Yekutieli D (2006) Adaptive linear step-up procedures that control the false discovery rate. Biometrika 93:491–507.Crossref, Google Scholar
• Bessembinder H, Burt A, Hrdlicka CM (2024) More factors matter and factors matter more than you might think: The role of time variation in factor premia. Preprint, submitted March 25, http://dx.doi.org/10.2139/ssrn.3992041.Google Scholar
• Brodeur A, Lé M, Sangnier M, Zylberberg Y (2016) Star wars: The empirics strike back. Amer. Econom. J. Appl. Econom. 8:1–32.Crossref, Google Scholar
• Canova F, Sala L (2009) Back to square one: Identification issues in DSGE models. J. Monetary Econom. 56:431–449.Crossref, Google Scholar
• Chen AY (2021a) The limits of p-hacking: Some thought experiments. J. Finance 76:2447–2480.Crossref, Google Scholar
• Chen AY (2021b) Most claimed statistical findings in cross-sectional return predictability are likely true. Preprint, submitted August 31, https://dx.doi.org/10.2139/ssrn.3912915.Google Scholar
• Chen AY, Velikov M (2023) Zeroing in on the expected returns of anomalies. J. Financial Quant. Anal. 58:968–1004.Crossref, Google Scholar
• Chen AY, Zimmermann T (2018) Publication Bias and the Cross-Section of Stock Returns, Finance and Economics Discussion Series 2018-033 (Board of Governors of the Federal Reserve System, Washington, DC).Google Scholar
• Chen AY, Zimmermann T (2020) Publication bias and the cross-section of stock returns. Rev. Asset Pricing Stud. 10:249–289.Crossref, Google Scholar
• Chen AY, Zimmermann T (2022) Open source cross-sectional asset pricing. Critical Finance Rev. 11(2):207–264.Google Scholar
• Chen AY, Zimmermann T (2023) Publication bias in asset pricing research. Oxford Res. Encyclopedia Econom. Finance (September 20), https://oxfordre.com/economics/view/10.1093/acrefore/9780190625979.001.0001/acrefore-9780190625979-e-888.Google Scholar
• Chinco A, Neuhierl A, Weber M (2021) Estimating the anomaly base rate. J. Financial Econom. 140:101–126.Crossref, Google Scholar
• Chordia T, Goyal A, Saretto A (2020) Anomalies and false rejections. Rev. Financial Stud. 33:2134–2179.Crossref, Google Scholar
• Cochrane JH (2005) The risk and return of venture capital. J. Financial Econom. 75:3–52.Crossref, Google Scholar
• Cochrane JH (2017) Macro-finance. Rev. Finance 21:945–985.Crossref, Google Scholar
• Copas J (1999) What works?: Selectivity models and meta-analysis. J. Roy. Statist. Soc. Ser. A 162:95–109.Crossref, Google Scholar
• Efron B (2008) Microarrays, empirical bayes and the two-groups model. Statist. Sci. 23(1):1–22.Google Scholar
• Efron B (2012) Large-Scale Inference: Empirical Bayes Methods for Estimation, Testing, and Prediction, vol. 1 (Cambridge University Press, Cambridge, UK).Google Scholar
• Efron B, Tibshirani RJ (1994) An Introduction to the Bootstrap (CRC Press, Boca Raton, FL).Crossref, Google Scholar
• Efron B, Tibshirani R (2002) Empirical bayes methods and false discovery rates for microarrays. Genetics Epidemiology 23:70–86.Crossref, Google Scholar
• Efron B, Tibshirani R, Storey JD, Tusher V (2001) Empirical Bayes analysis of a microarray experiment. J. Amer. Statist. Assoc. 96:1151–1160.Crossref, Google Scholar
• Fisher R (1925) Statistical Methods for Research Workers, 11th ed. rev. (Oliver and Boyd, Edinburgh, UK).Google Scholar
• Genovese C, Wasserman L (2002) Operating characteristics and extensions of the false discovery rate procedure. J. Roy. Statist. Soc. Ser. B Statist. Methodology 64:499–517.Crossref, Google Scholar
• Genovese C, Wasserman L (2004) A stochastic process approach to false discovery control. Ann. Statist. 32:1035–1061.Crossref, Google Scholar
• Harvey CR, Liu Y (2021) Uncovering the iceberg from its tip: A model of publication bias and p-hacking. Preprint, submitted June 22, https://dx.doi.org/10.2139/ssrn.3865813.Google Scholar
• Harvey CR, Liu Y, Zhu H (2016) …and the cross-section of expected returns. Rev. Financial Stud. 29:5–68.Crossref, Google Scholar
• Hedges LV (1992) Modeling publication selection effects in meta-analysis. Statist. Sci. 7(2):246–255.Google Scholar
• Hedges LV, Vevea J (2005) Selection method approaches. Rothstein HR, Sutton AJ, Borenstein M, eds. Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments (John Wiley & Sons, Ltd., Hoboken, NJ), 145–174.Google Scholar
• Ioannidis JP (2005) Why most published research findings are false. PLoS Medicine 2:e124.Crossref, Google Scholar
• Jacobs H, Müller S (2020) Anomalies across the globe: Once public, no longer existent? J. Financial Econom. 135:213–230.Crossref, Google Scholar
• Jensen TI, Kelly BT, Pedersen LH (2023) Is there a replication crisis in finance? J. Finance 78(5):2465–2518.Google Scholar
• Kasy M, Spiess J (2024) Optimal pre-analysis plans: Statistical decisions subject to implementability. CESifo Working paper, CESifo GmbH, Munich, Germany.Google Scholar
• Liu L, Moon HR, Schorfheide F (2020) Forecasting with dynamic panel data models. Econometrica 88:171–201.Crossref, Google Scholar
• McCrary J, Christensen G, Fanelli D (2016) Conservative tests under satisficing models of publication bias. PLoS One 11:e0149590.Crossref, Google Scholar
• McLean RD, Pontiff J (2016) Does academic research destroy stock return predictability? J. Finance 71:5–32.Crossref, Google Scholar
• McShane BB, Böckenholt U, Hansen KT (2016) Adjusting for publication bias in meta-analysis: An evaluation of selection methods and some cautionary notes. Perspective Psych. Sci. 11:730–749.Crossref, Google Scholar
• McShane BB, Gal D, Gelman A, Robert C, Tackett JL (2019) Abandon statistical significance. Amer. Statist. 73:235–245.Crossref, Google Scholar
• Olken BA (2015) Promises and perils of pre-analysis plans. J. Econom. Perspective 29:61–80.Crossref, Google Scholar
• Reiner-Benaim A (2007) FDR control by the BH procedure for two-sided correlated tests with implications to gene expression data analysis. Biomedicine J. 49:107–126.Google Scholar
• Storey JD (2002) A direct approach to false discovery rates. J. Roy. Statist. Soc. Ser. B Statist. Methodology 64:479–498.Crossref, Google Scholar
• Storey JD, Taylor JE, Siegmund D (2004) Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: A unified approach. J. Roy. Statist. Soc. Ser. B Statist. Methodology 66:187–205.Crossref, Google Scholar
• Wooldridge JM (1994) Estimation and inference for dependent processes. Engle RF, McFadden DL, eds. Handbook of Econometrics, vol. 4 (Elsevier Science B.V., Amsterdam), 2639–2738.Google Scholar
• Yan XS, Zheng L (2017) Fundamental analysis and the cross-section of stock returns: A data-mining approach. Rev. Financial Stud. 30:1382–1423.Crossref, Google Scholar