Do t-Statistic Hurdles Need to Be Raised?
Abstract
Many scholars have called for raising statistical hurdles to guard against false discoveries in academic publications. I show these calls may be difficult to justify empirically. Published data exhibit bias: Results that fail to meet existing hurdles are often unobserved. These unobserved results must be extrapolated, which can lead to weak identification of revised hurdles. In contrast, statistics that can target only published findings (e.g. empirical Bayes shrinkage and the false discovery rate) can be strongly identified, as data on published findings are plentiful. I demonstrate these results theoretically and in an empirical analysis of the cross-sectional return predictability literature.
This paper was accepted by Kay Giesecke, finance.
Supplemental Material: The data files are available at https://doi.org/10.1287/mnsc.2023.03083.
