Ensembles of Overfit and Overconfident Forecasts

Yael Grushka-Cockayne
Corresponding Author
Yael Grushka-Cockayne
[email protected]
Darden School of Business, University of Virginia, Charlottesville, Virginia 22903
Search for more papers by this author
,
Victor Richmond R. Jose
Victor Richmond R. Jose
[email protected]
McDonough School of Business, Georgetown University, Washington, DC 20057
Search for more papers by this author
,
Kenneth C. LichtendahlJr.
Kenneth C. LichtendahlJr.
[email protected]
Darden School of Business, University of Virginia, Charlottesville, Virginia 22903
Search for more papers by this author

Yael Grushka-Cockayne

Corresponding Author

Yael Grushka-Cockayne

[email protected]

Darden School of Business, University of Virginia, Charlottesville, Virginia 22903

Search for more papers by this author

Victor Richmond R. Jose

[email protected]

McDonough School of Business, Georgetown University, Washington, DC 20057

Search for more papers by this author

Kenneth C. LichtendahlJr.

[email protected]

Darden School of Business, University of Virginia, Charlottesville, Virginia 22903

Search for more papers by this author

Published Online:20 Apr 2016https://doi.org/10.1287/mnsc.2015.2389

Supplemental Material

mnsc.2015.2389-sm-online-suppl.pdf (214 KB)

Cited by
- What factors play an important role in crude oil returns forecasting? New evidence from group predictors and multiple time scales
  Journal of Commodity Markets, Vol. 42
- Quantile-adaptive probabilistic forecast combining
  European Journal of Operational Research, Vol. 330, No. 3
- Aggregating Judgmental Demand Forecasts in Environments with Structural Breaks
  Matthias Seifert,
  Yun Shin Lee,
  Shijith Kumar PM
  16 March 2026 | Decision Analysis, Vol. 0, No. 0
- Angular Combining of Forecasts of Probability Distributions
  James W. Taylor,
  Xiaochun Meng
  18 July 2025 | Management Science, Vol. 72, No. 3
- Fifty years of decision analysis in operational research: A review
  European Journal of Operational Research, Vol. 329, No. 2
- Probabilistic forecast aggregation with statistical depth
  European Journal of Operational Research, Vol. 328, No. 2
- Bayesian combination of correlated subjective probability estimates
  5 May 2026 | Judgment and Decision Making, Vol. 21
- An analytical framework for real-time gold trading using sentiment and time-series forecasting
  Decision Analytics Journal, Vol. 17
- FinTech: a literature review of emerging financial technologies and applications
  2 January 2025 | Financial Innovation, Vol. 11, No. 1
- Towards forecasting in management studies: insights from operations research and empirical evidence on gender and motherhood income gap
  18 November 2025 | Journal of the Operational Research Society, Vol. 91
- Machine learning-assisted prediction and identification of key factors affecting nitrogen metabolism for aerobic granular sludge
  Environmental Research, Vol. 273
- Introduction to the Special Issue on Judgment in Forecasting
  International Journal of Forecasting, Vol. 41, No. 2
- ASAS-NANP symposium: mathematical modeling in animal nutrition: synthetic database generation for non-normal multivariate distributions: a rank-based method with application to ruminant methane emissions
  4 May 2025 | Journal of Animal Science, Vol. 103
- Late Ming Dynasty weak monsoon induced a harmonized megadrought across north-to-south China
  17 August 2024 | Communications Earth & Environment, Vol. 5, No. 1
- Making the most of AI and machine learning in organizations and strategy research: Supervised machine learning, causal inference, and matching models
  15 May 2024 | Strategic Management Journal, Vol. 45, No. 10
- Effects of behavioral bias regarding demand forecasting in a competitive market
  2 March 2024 | Naval Research Logistics (NRL), Vol. 71, No. 6
- Calibrated explanations: With uncertainty information and counterfactuals
  Expert Systems with Applications, Vol. 246
- A comparative evaluation of machine learning ensemble approaches for disease prediction using multiple datasets
  27 March 2024 | Health and Technology, Vol. 14, No. 3
- Fabrication of 1D/2D Au nanofiber/MIL-101(Cr)–NH2 composite for selective electrochemical detection of caffeic acid: Predicting sensor performance by machine learning and investigating the porosity using AI and computer vision-based image analysis
  Microchemical Journal, Vol. 200
- Behavioral Biases in the Uncertainty Quantification Process
  31 May 2024
- The Role of Environmental Instability in Detecting and Responding to Signals of Impending Regime Shifts
  31 May 2024
- A dynamic ensemble approach for multi-step price prediction: Empirical evidence from crude oil and shipping market
  Expert Systems with Applications, Vol. 234
- Decision Making Under Impending Regime Shifts
  Matthias Seifert,
  Canan Ulu,
  Sreyaa Guha
  12 January 2023 | Management Science, Vol. 69, No. 10
- Forecast combinations: An over 50-year review
  International Journal of Forecasting, Vol. 39, No. 4
- Looking into Crystal Balls: A Laboratory Experiment on Reputational Cheap Talk
  Debrah Meloso,
  Salvatore Nunnari,
  Marco Ottaviani
  5 January 2023 | Management Science, Vol. 69, No. 9
- Bayesian forecast combination using time-varying features
  International Journal of Forecasting, Vol. 39, No. 3
- Using machine learning to analyze longitudinal data: A tutorial guide and best‐practice recommendations for social science researchers
  5 October 2022 | Applied Psychology, Vol. 72, No. 3
- Garbage in, Garbage out: A Theory-Driven Approach to Improve Data Handling in Supervised Machine Learning
- Combining probabilistic forecasts of COVID-19 mortality in the United States
  European Journal of Operational Research, Vol. 304, No. 1
- A normative model for Bayesian combination of subjective probability estimates
  24 November 2023 | Judgment and Decision Making, Vol. 18
- The season for large fires in Southern California is projected to lengthen in a changing climate
  17 February 2022 | Communications Earth & Environment, Vol. 3, No. 1
- Toward Efficient Ensemble Learning with Structure Constraints: Convergent Algorithms and Applications
  Shao-Bo Lin,
  Shaojie Tang,
  Yao Wang,
  Di Wang
  19 August 2022 | INFORMS Journal on Computing, Vol. 34, No. 6
- The M5 uncertainty competition: Results, findings and conclusions
  International Journal of Forecasting, Vol. 38, No. 4
- Good cause, not so good business? Sales and operations performance of cause‐related marketing
  14 February 2022 | Journal of Business Logistics, Vol. 43, No. 4
- Carbon price forecasting: a novel deep learning approach
  19 March 2022 | Environmental Science and Pollution Research, Vol. 29, No. 36
- Forecast with forecasts: Diversity matters
  European Journal of Operational Research, Vol. 301, No. 1
- Forecasting: theory and practice
  International Journal of Forecasting, Vol. 38, No. 3
- Convex combinations in judgment aggregation
  European Journal of Operational Research, Vol. 299, No. 2
- Estimating concentrations for particle and gases in a mechanically ventilated building in Hong Kong: multivariate method and machine learning
  29 September 2021 | Air Quality, Atmosphere & Health, Vol. 15, No. 1
- CAViAR Combination
  SSRN Electronic Journal, Vol. 9
- Organizations as Artificial Intelligences: The Use of Artificial Intelligence Analogies in Organization Theory
  Academy of Management Annals, Vol. 16, No. 1
- Evaluation of transfer learning in data-driven methods in the assessment of unconventional resources
  Journal of Petroleum Science and Engineering, Vol. 207
- RISK PREDICTION AND DIAGNOSIS OF WATER SEEPAGE IN OPERATIONAL SHIELD TUNNELS BASED ON RANDOM FOREST
  JOURNAL OF CIVIL ENGINEERING AND MANAGEMENT, Vol. 27, No. 7
- Statistical analysis of family based dispatching rules and preemption
  International Journal of Production Economics, Vol. 240
- Innovations in the Science and Practice of Decision Analysis: The Role of Management Science
  James S. Dyer,
  James E. Smith
  4 August 2020 | Management Science, Vol. 67, No. 9
- Probabilistic post-processing of gridded atmospheric variables and its application to site adaptation of shortwave solar radiation
  Solar Energy, Vol. 225
- Demand Forecasting with Supply‐Chain Information and Machine Learning: Evidence in the Pharmaceutical Industry
  1 September 2021 | Production and Operations Management, Vol. 30, No. 9
- Post-processing in solar forecasting: Ten overarching thinking tools
  Renewable and Sustainable Energy Reviews, Vol. 140
- Optimal selection of heterogeneous ensemble strategies of time series forecasting with multi-objective programming
  Expert Systems with Applications, Vol. 166
- Combining STRIPAT model and gated recurrent unit for forecasting nature gas consumption of China
  14 June 2020 | Mitigation and Adaptation Strategies for Global Change, Vol. 25, No. 7
- Machine Learning in Marketing: Overview, Learning Strategies, Applications, and Future Developments
  31 August 2020 | Foundations and Trends® in Marketing, Vol. 14, No. 3
- A Review of the Existing and Emerging Topics in the Supply Chain Risk Management Literature
  15 June 2020 | Decision Sciences, Vol. 51, No. 4
- Why do some combinations perform better than others?
  International Journal of Forecasting, Vol. 36, No. 1
- Combining prediction intervals in the M4 competition
  International Journal of Forecasting, Vol. 36, No. 1
- Probability Forecasts and Their Combination: A Research Perspective
  Robert L. Winkler,
  Yael Grushka-Cockayne,
  Kenneth C. Lichtendahl,
  Victor Richmond R. Jose
  6 November 2019 | Decision Analysis, Vol. 16, No. 4
- Hierarchical Demand Forecasting for Factory Production of Perishable Goods
- Behavioral Operations and Supply Chain Management–A Review and Literature Mapping
  5 April 2019 | Decision Sciences, Vol. 50, No. 6
- Improving the forecasting performance of temporal hierarchies
  3 October 2019 | PLOS ONE, Vol. 14, No. 10
- Large data sets and machine learning: Applications to statistical arbitrage
  European Journal of Operational Research, Vol. 278, No. 1
- When Algorithmic Predictions Use Human-Generated Data: A Bias-Aware Classification Algorithm for Breast Cancer Diagnosis
  Mehmet Eren Ahsen,
  Mehmet Ulvi Saygi Ayvaci,
  Srinivasan Raghunathan
  20 December 2018 | Information Systems Research, Vol. 30, No. 1
- Analysis of Big Data Method and Its Application
  Computer Science and Application, Vol. 09, No. 09
- The M4 Forecasting Competition Prediction Intervals
  SSRN Electronic Journal, Vol. 11
- Accounting Theory as a Bayesian Discipline
  28 December 2018 | Foundations and Trends® in Accounting, Vol. 13, No. 1-2
- Developing Theory Using Machine Learning Methods
  SSRN Electronic Journal, Vol. 355
- Averaging Probability Forecasts: Back to the Future
  SSRN Electronic Journal, Vol. 11
- A deep learning ensemble approach for crude oil price forecasting
  Energy Economics, Vol. 66
- Combining Interval Forecasts
  Anil Gaba,
  Ilia Tsetlin,
  Robert L. Winkler
  21 February 2017 | Decision Analysis, Vol. 14, No. 1
- When Algorithmic Predictions Use Human-Generated Data: A Bias-Aware Classification Algorithm for Breast Cancer Diagnosis
  SSRN Electronic Journal, Vol. 24

Volume 63, Issue 4

April 2017

Pages 901-1269

Article Information

Supplemental Material

Metrics

Information

Received:August 01, 2014
Accepted:September 28, 2015
Published Online:April 20, 2016

Cite as

Yael Grushka-Cockayne, Victor Richmond R. Jose, Kenneth C. LichtendahlJr. (2016) Ensembles of Overfit and Overconfident Forecasts. Management Science 63(4):1110-1130.

https://doi.org/10.1287/mnsc.2015.2389

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Ensembles of Overfit and Overconfident Forecasts

Supplemental Material

Volume 63, Issue 4

Article Information

Supplemental Material

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News