Combining Forecasts from Multiple Experts for Multiple Variables

References

• Agnew CE (1985) Multiple probability assessments by dependent experts. J. Amer. Statist. Assoc. 80(390):343–347.Crossref, Google Scholar
• Armstrong JS (2001) Combining forecasts. Armstrong JS, ed. Principles of Forecasting: A Handbook for Researchers and Practitioners (Springer Science & Business Media, New York), 417–439.Crossref, Google Scholar
• Bansal S, Gutierrez GJ (2020) Estimating uncertainties using judgmental forecasts with expert heterogeneity. Oper. Res. 68(2):363–380.Abstract, Google Scholar
• Bansal S, Gutierrez GJ, Keiser JR (2017) Using experts’ noisy quantile judgments to quantify risks: Theory and application to agribusiness. Oper. Res. 65(5):1115–1130.Link, Google Scholar
• Bates JM, Granger CWJ (1969) The combination of forecasts. J. Oper. Res. Soc. 20(4):451–468.Crossref, Google Scholar
• Blanc SM, Setzer T (2020) Bias–variance trade-off and shrinkage of weights in forecast combination. Management Sci. 66(12):5720–5737.Link, Google Scholar
• Bojer CS, Meldgaard JP (2021) Kaggle forecasting competitions: An overlooked learning opportunity. Internat. J. Forecasting 37(2):587–603.Crossref, Google Scholar
• Broomell SB, Budescu DV (2009) Why are experts correlated? Decomposing correlations between judges. Psychometrika 74(3):531–553.Crossref, Google Scholar
• Budescu DV, Chen E (2015) Identifying expertise to extract the wisdom of crowds. Management Sci. 61(2):267–280.Link, Google Scholar
• Bunn DW (1985) Statistical efficiency in the linear combination of forecasts. Internat. J. Forecasting 1(2):151–163.Crossref, Google Scholar
• Clemen RT (1989) Combining forecasts: A review and annotated bibliography. Internat. J. Forecasting 5(4):559–583.Crossref, Google Scholar
• Clemen RT, Winkler RL (1985) Limits for the precision and value of information from dependent sources. Oper. Res. 33(2):427–442.Link, Google Scholar
• Davis-Stober CP, Budescu DV, Broomell SB, Dana J (2015) The composition of optimally wise crowds. Decision Anal. 12(3):130–143.Link, Google Scholar
• Davis-Stober CP, Budescu DV, Dana J, Broomell SB (2014) When is a crowd wise? Decision 1(2):79–101.Crossref, Google Scholar
• Gaba A, Popescu DG, Chen Z (2019) Assessing uncertainty from point forecasts. Management Sci. 65(1):90–106.Link, Google Scholar
• Guo X, Lichtendahl KC Jr, Grushka-Cockayne Y (2025) Bayesian ensembles of exponentially smoothed life-cycle forecasts. Manufacturing Service Oper. Management 27(1):230–248.Link, Google Scholar
• Hammond JH, Raman A (1994) Sport Obermeyer Ltd. Harvard Business School Case No. 695-022, Harvard Business School, Boston.Google Scholar
• Hyndman RJ (2020) A brief history of forecasting competitions. Internat. J. Forecasting 36(1):7–14.Crossref, Google Scholar
• Jose VRR, Winkler RL (2008) Simple robust averages of forecasts: Some empirical results. Internat. J. Forecasting 24(1):163–169.Crossref, Google Scholar
• Jose VRR, Grushka-Cockayne Y, Lichtendahl KC Jr (2014) Trimmed opinion pools and the crowd’s calibration problem. Management Sci. 60(2):463–475.Link, Google Scholar
• Ke G, Meng Q, Finley T, Wang T, Chen W, Ma W, Ye Q, Liu T-Y (2017) LightGBM: A highly efficient gradient boosting decision tree. Guyon I, Von Luxburg U, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R, eds. Advances in Neural Information Processing Systems, vol. 30 (Curran Associates Inc., Red Hook, NY).Google Scholar
• Larrick RP, Soll JB (2006) Intuitions about combining opinions: Misappreciation of the averaging principle. Management Sci. 52(1):111–127.Link, Google Scholar
• Ledoit O, Wolf M (2004) A well-conditioned estimator for large-dimensional covariance matrices. J. Multivariate Anal. 88(2):365–411.Crossref, Google Scholar
• Ledoit O, Wolf M (2022) The power of (non-)linear shrinking: A review and guide to covariance matrix estimation. J Financial Econometrics 20(1):187–218.Crossref, Google Scholar
• Makridakis S, Spiliotis E, Assimakopoulos V (2020) The M4 competition: 100,000 time series and 61 forecasting methods. Internat. J. Forecasting 36(1):54–74.Crossref, Google Scholar
• Makridakis S, Spiliotis E, Assimakopoulos V (2022a) M5 accuracy competition: Results, findings, and conclusions. Internat. J. Forecasting 38(4):1346–1364.Crossref, Google Scholar
• Makridakis S, Spiliotis E, Assimakopoulos V, Chen Z, Gaba A, Tsetlin I, Winkler RL (2022b) The M5 uncertainty competition: Results, findings and conclusions. Internat. J. Forecasting 38(4):1365–1385.Crossref, Google Scholar
• Mannes AE, Soll JB, Larrick RP (2014) The wisdom of select crowds. J. Personality Soc. Psych. 107(2):276–299.Crossref, Google Scholar
• Nystrup P, Lindström E, Pinson P, Madsen H (2020) Temporal hierarchies with autocorrelation for load forecasting. Eur. J. Oper. Res. 280(3):876–888.Crossref, Google Scholar
• Palley AB, Satopää VA (2023) Boosting the wisdom of crowds within a single judgment problem: Weighted averaging based on peer predictions. Management Sci. 69(9):5128–5146.Link, Google Scholar
• Palley AB, Soll JB (2019) Extracting the wisdom of crowds when information is shared. Management Sci. 65(5):2291–2309.Abstract, Google Scholar
• Palley A, Steffen TD, Zhang F (2025) The effect of dispersion on the informativeness of analyst target prices. Management Sci. 71(3):2264–2288.Link, Google Scholar
• Pan SJ, Yang Q (2010) A survey on transfer learning. IEEE Trans. Knowledge Data Engrg. 22(10):1345–1359.Crossref, Google Scholar
• Petropoulos F, Hyndman RJ, Bergmeir C (2018) Exploring the sources of uncertainty: Why does bagging for time series forecasting work? Eur. J. Oper. Res. 268(2):545–554.Crossref, Google Scholar
• Petropoulos F, Apiletti D, Assimakopoulos V, Babai MZ, Barrow DK, Ben Taieb S, Bergmeir C, et al. (2022) Forecasting: Theory and practice. Internat. J. Forecasting 38(3):705–871.Crossref, Google Scholar
• Ramprasad P (2016) nlshrink: Non-linear shrinkage estimation of population eigenvalues and covariance matrices. Accessed March 10, 2025, https://CRAN.R-project.org/package=nlshrink.Google Scholar
• Rousseeuw PJ, Driessen KV (1999) A fast algorithm for the minimum covariance determinant estimator. Technometrics 41(3):212–223.Crossref, Google Scholar
• Rousseeuw PJ, Leroy AM (1987) Robust Regression and Outlier Detection (John Wiley & Sons, New York).Crossref, Google Scholar
• Rousseeuw PJ, Van Zomeren BC (1990) Unmasking multivariate outliers and leverage points. J. Amer. Statist. Assoc. 85(411):633–639.Crossref, Google Scholar
• Satopää VA (2021) Improving the wisdom of crowds with analysis of variance of predictions of related outcomes. Internat. J. Forecasting 37(4):1728–1747.Crossref, Google Scholar
• Satopää VA, Salikhov M, Tetlock PE, Mellers B (2021) Bias, information, noise: The bin model of forecasting. Management Sci. 67(12):7599–7618.Link, Google Scholar
• Schmittlein DC, Kim J, Morrison DG (1990) Combining forecasts: Operational adjustments to theoretically optimal rules. Management Sci. 36(9):1044–1056.Link, Google Scholar
• Soule D, Grushka-Cockayne Y, Merrick J (2024) A heuristic for combining correlated experts when there are few data. Management Sci. 70(10):6637–6668.Link, Google Scholar
• Stock JH, Watson MW (2004) Combination forecasts of output growth in a seven-country data set. J. Forecasting 23(6):405–430.Crossref, Google Scholar
• Stone M (1961) The opinion pool. Ann. Math Statist. 32(4):1339–1342.Crossref, Google Scholar
• Surowiecki J (2005) The Wisdom of Crowds (Anchor Books, New York).Google Scholar
• Taleb NN (2007) The Black Swan: The Impact of the Highly Improbable, vol. 2 (Random House, New York).Google Scholar
• Wang X, Hyndman RJ, Li F, Kang Y (2023) Forecast combinations: An over 50-year review. Internat. J. Forecasting 39(4):1518–1547.Crossref, Google Scholar
• Winkler RL (1981) Combining probability distributions from dependent information sources. Management Sci. 27(4):479–488.Link, Google Scholar
• Winkler RL (2015) Equal versus differential weighting in combining forecasts. Risk Anal. 35(1):16–18.Crossref, Google Scholar
• Winkler RL, Clemen RT (1992) Sensitivity of weights in combining forecasts. Oper. Res. 40(3):609–614.Link, Google Scholar
• Winkler RL, Makridakis S (1983) The combination of forecasts. J. Roy. Statist. Soc. Ser. A 146(2):150–157.Crossref, Google Scholar
• Winkler RL, Grushka-Cockayne Y, Lichtendahl KC Jr, Jose VRR (2019) Probability forecasts and their combination: A research perspective. Decision Anal. 16(4):239–260.Link, Google Scholar
• Zhang Y, Yang Q (2021) A survey on multi-task learning. IEEE Trans. Knowledge Data Engrg. 34(12):5586–5609.Crossref, Google Scholar
• Zhuang F, Qi Z, Duan K, Xi D, Zhu Y, Zhu H, Xiong H, He Q (2021) A comprehensive survey on transfer learning. Proc. IEEE 109(1):43–76.Crossref, Google Scholar