Eliciting Human Judgment for Prediction Algorithms

Published Online:https://doi.org/10.1287/mnsc.2020.3856

References

  • Alexander JC Jr (1995) Refining the degree of earnings surprise: A comparison of statistical and analysts’ forecasts. Financial Rev. 30(3):469–506.CrossrefGoogle Scholar
  • Arvan M , Fahimnia B , Reisi M , Siemsen E (2019) Integrating human judgement into quantitative forecasting methods: A review. Omega 86:(July 2019)237–252.CrossrefGoogle Scholar
  • Blattberg RC , Hoch SJ (1990) Database models and managerial intuition: 50% model+ 50% manager. Management Sci. 36(8):887–899.LinkGoogle Scholar
  • Campbell D , Frei F (2011) Market heterogeneity and local capacity decisions in services. Manufacturing Service Oper. Management 13(1):2–19.LinkGoogle Scholar
  • Carbone R , Andersen A , Corriveau Y , Corson PP (1983) Comparing for different time series methods the value of technical expertise individualized analysis, and judgmental adjustment. Management Sci. 29(5):559–566.LinkGoogle Scholar
  • Childers CP , Maggard-Gibbons M (2018) Understanding costs of care in the operating room. JAMA Surgery 153(4):e176233–e176233.CrossrefGoogle Scholar
  • Cowan R , David PA , Foray D (2000) The explicit economics of knowledge codification and tacitness. Indust. Corporate Change 9(2):211–253.CrossrefGoogle Scholar
  • Davis AM , Katok E , Kwasnica AM (2014) Should sellers prefer auctions? A laboratory comparison of auctions and sequential mechanisms. Management Sci. 60(4):990–1008.LinkGoogle Scholar
  • Fildes R , Goodwin P , Lawrence M , Nikolopoulos K (2009) Effective forecasting and judgmental adjustments: An empirical evaluation and strategies for improvement in supply chain planning. Internat. J. Forecasting 25(1):3–23.CrossrefGoogle Scholar
  • Fox CR , Clemen RT (2005) Subjective probability assessment in decision analysis: Partition dependence and bias toward the ignorance prior. Management Sci. 51(9):1417–1432.LinkGoogle Scholar
  • Goodwin P (2000) Correct or combine? Mechanically integrating judgmental forecasts with statistical methods. Internat. J. Forecasting 16(2):261–275.CrossrefGoogle Scholar
  • Hendriks A (2012) SoPHIE - Software platform for human interaction experiments. Working paper, University of Osnabrueck, Osnabrück, Germany.Google Scholar
  • Herzog SM , Hertwig R (2009) The wisdom of many in one mind: Improving individual judgments with dialectical bootstrapping. Psych. Sci. 20(2):231–237.CrossrefGoogle Scholar
  • Ho TH , Zhang J (2008) Designing pricing contracts for boundedly rational customers: Does the framing of the fixed fee matter? Management Sci. 54(4):686–700.LinkGoogle Scholar
  • Hosseini N , Sir MY , Jankowski C , Pasupathy KS (2015) Surgical duration estimation via data mining and predictive modeling: A case study. AMIA Annual Sympos. Proc. 2015:640–648.Google Scholar
  • Huang T , Allon G , Bassamboo A (2013) Bounded rationality in service systems. Manufacturing Service Oper. Management 15(2):263–279.LinkGoogle Scholar
  • Ibrahim R , Kim SH (2019) Is expert input valuable? The case of predicting surgery duration. Seoul J. Bus. 25(2):1–34.CrossrefGoogle Scholar
  • Kahneman D , Rosenfield A , Gandhi L , Blaser T (2016) Noise: How to overcome the high, hidden cost of inconsistent decision making. Harvard Bus. Rev. 94(2016):38–46.Google Scholar
  • Kesavan S , Kushwaha T (2020) Field experiment on the profit implications of merchants’ discretionary power to override data-driven decision-making tools. Management Sci. Forthcoming.Google Scholar
  • Kim SH , Chan CW , Olivares M , Escobar G (2015) ICU admission control: An empirical study of capacity allocation and its implication for patient outcomes. Management Sci. 61(1):19–38.LinkGoogle Scholar
  • Kremer M , Siemsen E , Thomas DJ (2016) The sum and its parts: Judgmental hierarchical forecasting. Management Sci. 62(9):2745–2764.LinkGoogle Scholar
  • Lawrence M , O’Connor M , Edmundson B (2000) A field study of sales forecasting accuracy and processes. Eur. J. Oper. Res. 122(1):151–160.CrossrefGoogle Scholar
  • Lawrence M , Goodwin P , O’Connor M , Önkal D (2006) Judgmental forecasting: A review of progress over the last 25 years. Internat. J. Forecasting 22(3):493–518.CrossrefGoogle Scholar
  • Macario A (2006) Are your hospital operating rooms “efficient”? A scoring system with eight performance indicators. Anesthesiology 105(2):237–240.CrossrefGoogle Scholar
  • Mannes AE , Larrick RP , Soll JB (2012) The social psychology of the wisdom of crowds. Krueger JI, ed. Social Judgment and Decision Making, Frontiers of Social Psychology (Psychology Press, New York), 227–242.Google Scholar
  • Osadchiy N , Gaur V , Seshadri S (2013) Sales forecasting with financial indicators and experts’ input. Production Oper. Management 22(5):1056–1076.CrossrefGoogle Scholar
  • Palley AB , Soll JB (2019) Extracting the wisdom of crowds when information is shared. Management Sci. 65(5):2291–2309.AbstractGoogle Scholar
  • Pauker SG , Gorry GA , Kassirer JP , Schwartz WB (1976) Toward the simulation of clinical cognition: taking a present illness by computer. Amer. J. Medicine 60(7):981–996.CrossrefGoogle Scholar
  • Phillips R , Şimşek AS , Van Ryzin G (2015) The effectiveness of field price discretion: Empirical evidence from auto lending. Management Sci. 61(8):1741–1759.LinkGoogle Scholar
  • Pollack AH , Tweedy CG , Blondon K , Pratt W (2014) Knowledge crystallization and clinical priorities: Evaluating how physicians collect and synthesize patient-related data. AMIA Annual Sympos. Proc. 2014:1874–1883.Google Scholar
  • Rothschild M , Stiglitz JE (1970) Increasing risk, I: A definition. J. Econom. Theory 2(3):225–243.CrossrefGoogle Scholar
  • Su X (2008) Bounded rationality in newsvendor models. Manufacturing Service Oper. Management 10(4):566–589.LinkGoogle Scholar
  • Surowiecki J (2005) The Wisdom of Crowds (Anchor, New York).Google Scholar
  • Tong J , Feiler D (2017) A behavioral model of forecasting: Naive statistics on mental samples. Management Sci. 63(11):3609–3627.LinkGoogle Scholar
  • Vul E , Pashler H (2008) Measuring the crowd within: Probabilistic representations within individuals. Psych. Sci. 19(7):645–647.CrossrefGoogle Scholar
  • Zhou J , Dexter F (1998) Method to assist in the scheduling of add-on surgical cases-upper prediction bounds for surgical case durations based on the log-normal distribution. Anesthesiology 89(5):1228–1232.CrossrefGoogle Scholar
INFORMS site uses cookies to store information on your computer. Some are essential to make our site work; Others help us improve the user experience. By using this site, you consent to the placement of these cookies. Please read our Privacy Statement to learn more.