Extremizing and Antiextremizing in Bayesian Ensembles of Binary-Event Forecasts

References

• Ariely D, Au WT, Bender RH, Budescu DV, Dietz CB, Gu H, Wallsten TS, Zauberman G (2000) The effects of averaging subjective probability estimates between and within judges. J. Experiment. Psych. Appl. 6(2):130–146.Crossref, Google Scholar
• Baron J, Mellers BA, Tetlock PE, Stone E, Ungar LH (2014) Two reasons to make aggregated probability forecasts more extreme. Decision Anal. 11(2):133–145.Link, Google Scholar
• Bernardo JM, Smith AFM (2000) Bayesian Theory (John Wiley & Sons, Ltd., Chichester, England).Google Scholar
• Box GEP, Tiao GC (1973) Bayesian Inference in Statistical Inference (Addison-Wesley, Reading, MA).Google Scholar
• Breiman L (1996) Bagging predictors. Machine Learn. 24(2):123–140.Crossref, Google Scholar
• Breiman L (2001) Random forests. Machine Learn. 45(1):5–32.Crossref, Google Scholar
• Chen T, Guestrin C (2016) Xgboost: A scalable tree boosting system. Proc. 22nd ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (ACM), 785–794.Google Scholar
• Chipman HA, George EI, Mcculloch RE. (2007) Bayesian ensemble learning. Schölkopf PB, Platt JC, Hoffman T, eds. Adv. Neural Inform. Processing Systems, vol. 19 (MIT Press, Cambridge, MA), 265–272.Google Scholar
• Clemen RT (1987) Combining overlapping information. Management Sci. 33(3):373–380.Link, Google Scholar
• Clemen RT, Winkler RL (1986) Combining economic forecasts. J. Bus. Econom. Statist. 4(1):39–46.Crossref, Google Scholar
• Dawid AP, DeGroot MH, Mortera J (1995) Coherent combination of experts’ opinions. TEST 4(2):263–313.Crossref, Google Scholar
• DeGroot MH (1974) Reaching a consensus. J. Amer. Statist. Assoc. 69(345):118–121.Crossref, Google Scholar
• DeGroot MH, Mortera J (1991) Optimal linear opinion pools. Management Sci. 37(5):546–558.Link, Google Scholar
• Džeroski S, Ženko B (2004) Is combining classifiers with stacking better than selecting the best one? Machine Learn. 54(3):255–273.Crossref, Google Scholar
• Erev I, Wallsten TS, Budescu DV (1994) Simultaneous over- and underconfidence: The role of error in judgment processes. Psych. Rev. 101(3):519–527.Crossref, Google Scholar
• French S (1980) Updating of belief in the light of someone else’s opinion. J. Roy. Statist. Soc. Ser. A 143(1):43–48.Crossref, Google Scholar
• French S (1986) Calibration and the expert problem. Management Sci. 32(3):315–321.Link, Google Scholar
• Gaba A, Tsetlin I, Winkler RL (2017) Combining interval forecasts. Decision Anal. 14(1):1–20.Link, Google Scholar
• Genest C, Zidek JV (1986) Combining probability distributions: A critique and an annotated bibliography. Statist. Sci. 1(1):114–135.Crossref, Google Scholar
• Gneiting T, Raftery AE (2007) Strictly proper scoring rules, prediction, and estimation. J. Amer. Statist. Assoc. 102(477):359–378.Crossref, Google Scholar
• Grushka-Cockayne Y, Lichtendahl KC Jr, Jose VRR, Winkler RL (2017) Quantile evaluation, sensitivity to bracketing, and sharing business payoffs. Oper. Res. 65(3):712–728.Link, Google Scholar
• Hora SC (2004) Probability judgments for continuous quantities: Linear combinations and calibration. Management Sci. 50(5):597–604.Link, Google Scholar
• Karmarkar US (1978) Subjectively weighted utility: A descriptive extension of the expected utility model. Organ. Behav. Human Performance 21(1):61–72.Crossref, Google Scholar
• Kaunitz L, Zhong S, Kreiner J (2017) Beating the bookies with their own numbers—And how the online sports betting market is rigged. Preprint, https://arxiv.org/abs/1710.02824.Google Scholar
• Larrick RP, Soll JB (2006) Intuitions about combining opinions: Misappreciation of the averaging principle. Management Sci. 52(1):111–127.Link, Google Scholar
• Lindley D (1982) The improvement of probability assessments. J. Roy. Statist. Soc. Ser. A 145(1):117–126.Crossref, Google Scholar
• Lindley DV, Tversky A, Brown RV (1979) On the reconciliation of probability assessments. J. Roy. Statist. Soc. Ser. A 142(2):146–180.Crossref, Google Scholar
• Mellers B, Ungar L, Baron J, Ramos J, Gurcay B, Fincher K, Scott SE, et al. (2014) Psychological strategies for winning a geopolitical forecasting tournament. Psych. Sci. 25(5):1106–1115.Crossref, Google Scholar
• Mineo AM, Ruggieri M (2005) A software tool for the exponential power distribution: The normalp package. J. Statist. Software 12(4):1–24.Crossref, Google Scholar
• Morris PA (1974) Decision analysis expert use. Management Sci. 20(9):1233–1241.Link, Google Scholar
• Murphy AH, Winkler RL (1987) A general framework for forecast verification. Monthly Weather Rev. 115(7):1330–1338.Crossref, Google Scholar
• Office of the Director of National Intelligence (2018) IARPA announces the geopolitical forecasting challenge to improve crowdsourced forecasts. https://www.dni.gov/index.php/newsroom/press-releases/item/1838-iarpa-announces-the-geopolitical-forecasting-challenge-to-improve-crowdsourced-forecasts.Google Scholar
• Raiffa H, Schlaifer R (1961) Applied Statistical Decision Theory (Harvard Business School, Boston).Google Scholar
• Ranjan R, Gneiting T (2010) Combining probability forecasts. J. Roy. Statist. Soc. Ser. B Statist. Methodology 72(1):71–91.Crossref, Google Scholar
• Satopää VA, Pemantle R, Ungar LH (2016) Modeling probability forecasts via information diversity. J. Amer. Statist. Assoc. 111(516):1623–1633.Crossref, Google Scholar
• Satopää VA, Baron J, Foster DP, Mellers BA, Tetlock PE, Ungar LH (2014) Combining multiple probability predictions using a simple logit model. Internat. J. Forecasting 30(2):344–356.Crossref, Google Scholar
• Shlomi Y, Wallsten TS (2010) Subjective recalibration of advisors’ probability estimates. Psychonomic Bull. Rev. 17(4):492–498.Crossref, Google Scholar
• Smyth P, Wolpert D (1999) Linearly combining density estimators via stacking. Machine Learn. 36(1–2):59–83.Crossref, Google Scholar
• Soury H, Alouini MS (2015) New results on the sum of two generalized Gaussian random variables. 2015 IEEE Global Conf. Signal Inform. Processing (IEEE), 1017–1021.Google Scholar
• Stone M (1961) The opinion pool. Ann. Math. Statist. 32(4):1339–1342.Crossref, Google Scholar
• Subbotin MT (1923) On the law of frequency of error. Matematicheskii Sbornik 31(2):296–301.Google Scholar
• Tibshirani R (1996) Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. B 58(1):267–288.Crossref, Google Scholar
• Turner BM, Steyvers M, Merkle EC, Budescu DV, Wallsten TS (2014) Forecast aggregation via recalibration. Machine Learn. 95(3):261–289.Crossref, Google Scholar
• Wallsten TS, Budescu DV, Erev I, Diederich A (1997) Evaluating and combining subjective probability estimates. J. Behav. Decision Making 10(3):243–268.Crossref, Google Scholar
• Winkler RL (1968) The consensus of subjective probability distributions. Management Sci. 15(2):B61–B75.Link, Google Scholar
• Winkler RL (1981) Combining probability distributions from dependent information sources. Management Sci. 27(4):479–488.Google Scholar
• Winkler RL (1994) Evaluating probabilities: Asymmetric scoring rules. Management Sci. 40(11):1395–1405.Link, Google Scholar
• Winkler RL, Jose VRR (2008) Comments on: Assessing probabilistic forecasts of multivariate quantities, with an application to ensemble predictions of surface winds. TEST 17:251–255.Crossref, Google Scholar
• Winkler RL, Poses RM (1993) Evaluating and combining physicians’ probabilities of survival in an intensive care unit. Management Sci. 39(12):1526–1543.Link, Google Scholar
• Winkler RL, Jose VRR, Lichtendahl KC Jr, Grushka-Cockayne Y (2018) Contributed discussion to Yao et al. 2018. Bayesian Anal. 13(3):968–970.Google Scholar
• Wolpert DH (1992) Stacked generalization. Neural Networks 5(2):241–259.Crossref, Google Scholar
• Yao Y, Vehtari A, Simpson D, Gelman A (2018) Using stacking to average Bayesian predictive distributions (with discussion). Bayesian Anal. 13(3):917–1003.Crossref, Google Scholar
• Zhang Z, Wang S, Liu D, Jordan MI (2012) EP-GIG priors and applications in Bayesian sparse learning. J. Machine Learn. Res. 13:2031–2061.Google Scholar