OM Forum—The Best of Both Worlds: Machine Learning and Behavioral Science in Operations Management

References

• Agrawal A, Gans J, Goldfarb A (2018) Prediction Machines: The Simple Economics of Artificial Intelligence (Harvard Business Review Press, Brighton, MA).Google Scholar
• Allon G, Hanany E (2012) Cutting in line: Social norms in queues. Management Sci. 58(3):493–506.Link, Google Scholar
• Agan AY, Diag D, Ludwig J, Mullainathan S (2023) Automating automaticity: How the context of human choice affects the extent of algorithmic bias. National Bureau of Economic Research, No. 30981, National Bureau of Economic Research, Cambridge, MA.Google Scholar
• Ang E, Kwasnick S, Bayati M, Plambeck EL, Aratow M (2016) Accurate Emergency Department wait time prediction. Manufacturing Service Oper. Management 18(1):141–156.Link, Google Scholar
• Arlot S, Celisse A (2010) A survey of cross validation procedures for model selection. Stat. Surv. 4:40–79.Crossref, Google Scholar
• Ata B, Skaro A, Tayur S (2016) OrganJet: Overcoming geographical disparities in access to deceased donor kidneys in the United States. Management Sci. 63(9):2776–2794.Link, Google Scholar
• Athey S, Tibshirani J, Wager S (2019) Generalized random forests. Ann. Statist. 47(2):1148–1178.Crossref, Google Scholar
• Authors blinded for peer review (2024) Fairness in Crowdwork: Making the human AI supply chain more humane.Google Scholar
• Babic B, Cohen IG, Evgeniou T, Gerke S (2021) When machine learning goes off the rails. Harvard Bus. Rev. (January–February), https://hbr.org/2021/01/when-machine-learning-goes-off-the-rails.Google Scholar
• Bai B, Dai H, Zhang DJ, Zhang F, Hu H (2022) The impacts of algorithmic work assignment on fairness perceptions and productivity: Evidence from field experiments. Working paper, Olin Business School, Washington University, St. Louis.Google Scholar
• Bastani H, Bastani O, Sinchaisri WP (2022) Improving decision-making with machine learning. Working paper, The Wharton School, University of Pennsylvania, Philadelphia.Google Scholar
• Bearden WO, Netemeyer RG (1999) Handbook of Marketing Scales: Multi-item Measures for Marketing and Consumer Behavior Research (Sage Publications Inc., Thousand Oaks, CA).Crossref, Google Scholar
• Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J. Machine Learn. Res. 3:993–1022.Google Scholar
• Blythe S (2018) Big data and machine learning won’t save us from another financial crisis. Harvard Bus. Rev. (September 18), https://hbr.org/2018/09/big-data-and-machine-learning-wont-save-us-from-another-financial-crisis.Google Scholar
• Bolton GE, Chen Y (2019) Other-regarding behavior: Fairness, reciprocity, and trust. Donohue K, Katok E, Leider S, eds. The Handbook of Behavioral Operations (John Wiley & Sons, Hoboken, NJ), 199–236.Google Scholar
• Bolton GE, Katok E (2018) Cry wolf or equivocate? Credible forecast guidance in a cost-loss game. Management Sci. 64(3):1440–1457.Link, Google Scholar
• Bolton GE, Ockenfels A, Thonemann UW (2012) Managers and students as newsvendors. Management Sci. 58(12):2225–2233.Link, Google Scholar
• Boyaci T, Canyakmaz C, de Véricourt F (2024) Human and machine: The impact of machine input on decision making under cognitive limitations. Management Sci. Forthcoming.Link, Google Scholar
• Brown TB, Mann B, Ryder N, Subbiah M, Kaplan J, Dhariwal P, Neelakantan A, et al. (2020) Language models are few-shot learners. Adv. Neural Inform. Process. Syst. 33:1877–1901.Google Scholar
• Buell RW (2018) The parts of customer service that should never be automated. Harvard Bus. Rev. (February 19), https://hbr.org/2018/02/the-parts-of-customer-service-that-should-never-be-automated.Google Scholar
• Buell RW (2021) Last-place aversion in queues. Management Sci. 67(3):1430–1452.Link, Google Scholar
• Buell RW, Kim T, Tsay CJ (2017) Creating reciprocal value through operational transparency. Management Sci. 63(6):1673–1695.Link, Google Scholar
• Burton JW, Stein M-K, Jensen TB (2020) A systematic review of algorithm aversion in augmented decision making. J. Behav. Decision Making 33:220–239.Crossref, Google Scholar
• Camerer CF (2003) Behavioral Game Theory: Experiments in Strategic Interaction (Princeton University Press, Princeton, NJ).Google Scholar
• Camerer CF, Nave G, Smith A (2019) Dynamic unstructured bargaining with private information: Theory, experiment, and outcome prediction via machine learning. Management Sci. 65(4):1867–1890.Link, Google Scholar
• Caro F, Saez de Tejada Cuenca A (2023) Believing in analytics: Managers’ adherence to price recommendations from a DSS. Manufacturing Service Oper. Management 25(2):524–542.Google Scholar
• Chen N, Hu M, Li W (2022) Algorithmic decision-making safeguarded by human knowledge. Preprint, submitted November 20, https://arxiv.org/abs/2211.11028.Google Scholar
• Chen CJ, Jain N, Karamshetty V (2023) Algorithm-human-algorithm: A new classification approach to integrating judgemental adjustments. ICIS 2023 Proc., vol. 24 (AIS eLibrary).Google Scholar
• Corbett CJ, Van Wassenhove LN (1993) The natural drift: What happened to operations research? Oper. Res. 41(4):625–640.Link, Google Scholar
• Cukier K, Mayer-Schönberger V, de Véricourt F (2021) Framers: Human Advantage in an Age of Technology and Turmoil (Penguin Random House, New York).Google Scholar
• Cui Y, Davis AM (2022) Tax-induced inequalities in the sharing economy. Management Sci. 68(10):7202–7220.Link, Google Scholar
• Cui TH, Wu Y (2019) Incorporating behavioral factors into operations theory. Donohue K, Katok E, Leider S, eds. The Handbook of Behavioral Operations (John Wiley & Sons, Hoboken, NJ).Google Scholar
• Dai T, Singh S (2023) Artificial intelligence on call: The physician’s decision of whether to use AI in clinical practice. Working paper, Johns Hopkins University, Baltimore.Google Scholar
• Davis AM (2019) Biases in individual decision-making. Donohue K, Katok E, Leider S, eds. The Handbook of Behavioral Operations (John Wiley & Sons, Hoboken, NJ).Google Scholar
• Davis AM, Flicker B, Hyndman K, Katok E, Keppler S, Leider S, Long X, Tong JD (2023) A replication study of operations management experiments in Management Science. Management Sci. 69(9):4977–4991.Link, Google Scholar
• de Véricourt F, Gurkan H (2024) Is your machine better than you? You may never know. Management Sci. Forthcoming.Google Scholar
• de Véricourt F, Perakis G (2020) Frontiers in service science: The management of data analytics services: New challenges and future directions. Serv. Sci. 12(4):121–129.Link, Google Scholar
• De‐Arteaga M, Feuerriegel S, Saar‐Tsechansky M (2022) Algorithmic fairness in business analytics: Directions for research and practice. Production Oper. Management 31(10):3749–3770.Crossref, Google Scholar
• Dell’Acqua F, McFowland E, Mollick ER, Lifshitz-Assaf H, Kellogg K, Rajendran S, Krayer L, Candelon F, Lakhani KR (2023) Navigating the jagged technological frontiers: Field experimental evidence of the effects of AI on knowledge worker productivity and quality. Working Paper No. 24-013, Harvard Business School, Cambridge, MA.Google Scholar
• Devlin J, Chang M-W, Lee K, Toutanova K (2019) Bert: Pre-training of deep bidirectional transformers for language understanding. Proc. NAACL-HLT (Association for Computational Linguistics, Minneapolis, MN), 4171–4186.Google Scholar
• Dietvorst BJ, Simmons JP, Massey C (2015) Algorithm aversion: People erroneously avoid algorithms after seeing them err. J. Exp. Psychol. Gen. 144(1):114–126.Crossref, Google Scholar
• Donohue K, Katok E, Leider S, eds. (2019) The Handbook of Behavioral Operations (John Wiley & Sons, Hoboken, NJ).Google Scholar
• Eberhardt F, Kaynar N, Siddiq A (2024) Discovering causal models with optimization: Confounders, cycles, and feature selection. Management Sci. Forthcoming.Link, Google Scholar
• Fisher G (2023) Measuring the factors influencing purchasing decisions: Evidence from cursor tracking and cognitive modeling. Management Sci. 69(8):4558–4578.Link, Google Scholar
• Gavirneni S, Isen AM (2010) Anatomy of a newsvendor decision: Observations from a verbal protocol analysis. Production Oper. Management 19(4):453–462.Crossref, Google Scholar
• Grand-Clément J, Pauphilet J (2024) The best decisions are not the best advice: Making adherence-aware recommendations. Management Sci., ePub ahead of print June 10, https://doi.org/10.1287/mnsc.2023.01851.Google Scholar
• Grün B, Hornik K (2011) topicmodels: An R package for fitting topic models. J. Statist. Software 40(13):1–30.Google Scholar
• Goodell JW, Kumar S, Lim WM, Pattnaik D (2021) Artificial intelligence and machine learning in finance: Identifying foundations, themes, and research clusters from bibliometric analysis. J. Behav. Exp. Finance 32:100577.Crossref, Google Scholar
• Gurkan H, de Véricourt F (2022) Contracting, pricing, and data collection under the AI flywheel effect. Management Sci. 68(12):8791–8808.Link, Google Scholar
• Hodrick RJ, Prescott EC (1997) Postwar U.S. business cycles: An empirical investigation. J. Money Credit Bank. 29(1):1–16.Crossref, Google Scholar
• Horton JJ (2017) The effects of algorithmic labor market recommendations: Evidence from a field experiment. J. Labor Econom. 35(2):345–385.Crossref, Google Scholar
• Hunt D (2021) Can algorithms be ethical? ORMS Today (December 8), https://pubsonline.informs.org/do/10.1287/orms.2021.06.12/full.Google Scholar
• Hutson M (2018) Artificial intelligence faces reproducibility crisis. Science 359(6377):725–726.Crossref, Google Scholar
• Hyndman K (2019) Econometrics for experiments. Donohue K, Katok E, Leider S, eds. The Handbook of Behavioral Operations (John Wiley & Sons, Hoboken, NJ), 35–88.Google Scholar
• Ibanez MR, Staats BR (2019) Behavioral empirics and field experiments. Donohue K, Katok E, Leider S, eds. The Handbook of Behavioral Operations (John Wiley & Sons, Hoboken, NJ), 121–148.Google Scholar
• Ibrahim R, Kim S-H (2019) Is expert input valuable? The case of predicting surgery duration. Seoul J. Bus. 25(2):1–34.Crossref, Google Scholar
• Ibrahim R, Kim SH, Tong J (2021) Eliciting human judgment for prediction algorithms. Management Sci. 67(4):2314–2325.Link, Google Scholar
• Johnsen LC, Voigt G, Corbett CJ (2019) Behavioral contract design under asymmetric forecast information. Decision Sci. 50(4):786–815.Crossref, Google Scholar
• Kagel JH, Roth AE (2016) The Handbook of Experimental Economics, vol. 2 (Princeton University Press, Princeton, NJ).Google Scholar
• Kahneman D (2011) Thinking Fast and Slow (Farrar, Straus, and Giroux, New York).Google Scholar
• Kahneman D, Tversky A (1979) Prospect theory: An analysis of decision under risk. Econometrica 47(2):263–292.Crossref, Google Scholar
• Katok E (2019) Designing and conducting laboratory experiments. Donohue K, Katok E, Leider S, eds. The Handbook of Behavioral Operations (John Wiley & Sons, Hoboken, NJ), 3–34.Google Scholar
• Kelliher R (2021) AI in admissions can reduce or reinforce biases. Diverse, Issues in Higher Education (September 2), https://www.diverseeducation.com/students/article/15114427/ai-in-admissions-can-reduce-or-reinforce-biases.Google Scholar
• Kesavan S, Kushwaha T (2020) Field experiment on the profit implications of merchants’ discretionary power to override data-driven decision-making tools. Management Sci. 66(11):5182–5190.Link, Google Scholar
• Kleinberg J, Mullainathan S, Raghavan M (2023b) The challenge of understanding what users want: Inconsistent preferences and engagement optimization. Management Sci., ePub ahead of print November 7, https://doi.org/10.1287/mnsc.2022.03683.Link, Google Scholar
• Kleinberg J, Ludwig J, Mullainathan S, Raghavan M (2023a) The inversion problem: Why algorithms should infer mental state and not just predict behavior. Perspect. Psychol. Sci., ePub ahead of print December 12, https://doi.org/10.1177/17456916231212138.Crossref, Google Scholar
• Kleinberg J, Lakkaraju H, Leskovec J, Ludwig J, Mullainathan S (2018) Human decisions and machine predictions. Quart. J. Econom. 133(1):237–293.Crossref, Google Scholar
• Klockmann V, von Schenk A, Villeval MC (2022) Artificial intelligence, ethics, and intergenerational responsibility. J. Econom. Behav. Organ. 203:284–317.Google Scholar
• Kremer M, Debo L (2016) Inferring quality from wait time. Management Sci. 62(10):3023–3038.Link, Google Scholar
• Larson EJ (2021) The Myth of Artificial Intelligence: Why Computers Can’t Think the Way We Do (Harvard University Press, Cambridge, MA).Google Scholar
• LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444.Crossref, Google Scholar
• Lee YS, Siemsen E (2017) Task decomposition and newsvendor decision making. Management Sci. 63(10):3226–3245.Link, Google Scholar
• Leider S, Lovejoy WS (2016) Bargaining in supply chains. Management Sci. 62(10):3039–3058.Link, Google Scholar
• Li J, Beil DR, Leider S (2019) Team decision making in operations management. Working paper, University of Michigan, Ann Arbor, MI.Google Scholar
• Li J, Netessine S, Koulayev S (2018) Price to compete… with many: How to identify price competition in high-dimensional space. Management Sci. 64(9):4118–4136.Link, Google Scholar
• Libby R, Bloomfield R, Nelson MW (2002) Experimental research in financial accounting. Account. Organ. Soc. 27(8):775–810.Crossref, Google Scholar
• Liu B (2020) Sentiment Analysis: Mining Opinions, Sentiments, and Emotions (Cambridge University Press, Cambridge, UK).Crossref, Google Scholar
• Loughran T, McDonald B (2011) When is a liability not a liability? Textual analysis, dictionaries, and 10‐Ks. J. Finance 66(1):35–65.Crossref, Google Scholar
• Lu Y, Musalem A, Olivares M, Schilkrut A (2013) Measuring the effect of queues on customer purchases. Management Sci. 59(8):1743–1763.Link, Google Scholar
• Luca M, Kleinberg J, Mullainathan S (2016) Algorithms need managers, too. Harvard Bus. Rev. (January–February) https://hbr.org/2016/01/algorithms-need-managers-too.Google Scholar
• Lundberg SM, Lee S-I (2017) A unified approach to interpreting model predictions. Guyon I, Von Luxburg U, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R, eds. Advances in Neural Information Processing Systems, vol. 30 (Curran Associates, Inc., Red Hook, NY).Google Scholar
• McLaughlin B, Spiess J (2024) Algorithmic assistance with recommendation-dependent preferences. Working paper, Stanford University, Stanford, CA.Google Scholar
• Mejia J, Mankad S, Gopal A (2021) Service quality using text mining: Measurement and consequences. Manufacturing Service Oper. Management 23(6):1354–1372.Link, Google Scholar
• Mišić VV, Perakis G (2020) Data analytics in operations management: A review. Manufacturing Service Oper. Management 22(1):158–169.Link, Google Scholar
• Mukherjee A, Chang H, Gupta S (2023) Bridging the gap: Using interpretable AI to incorporate real-world product descriptions in consumer research experiments. Working paper, Cornell University, Ithaca, NY.Google Scholar
• Mullainathan S, Rambachan A (2023) From predictive algorithms to automatic generation of anomalies. Working paper, MIT, Cambridge, MA.Google Scholar
• Niu S, Liu Y, Wang J, Song H (2020) A decade survey of transfer learning (2010–2020). IEEE Trans. Artificial Intelligence 1(2):151–166.Crossref, Google Scholar
• O’Neil C (2016) Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy (Crown Books, New York).Google Scholar
• Özer Ö, Zheng Y, Chen KY (2011) Trust in forecast information sharing. Management Sci. 57(6):1111–1137.Link, Google Scholar
• Pan SJ, Yang Q (2009) A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22(10):1345–1359.Crossref, Google Scholar
• Pasquale F (2015) Front matter. The Black Box Society: The Secret Algorithms That Control Money and Information (Harvard University Press, Cambridge, MA), i–vi.Google Scholar
• Picard R (2000) Affective Computing (MIT Press, Cambridge, MA).Crossref, Google Scholar
• Rajkomar A, Dean J, Kohane I (2019) Machine learning in medicine. New Engl. J. Med. 380(14):1347–1358.Crossref, Google Scholar
• Ren Y, Croson R (2013) Overconfidence in newsvendor orders: An experimental study. Management Sci. 59(11):2502–2517.Link, Google Scholar
• Ribeiro MT, Singh S, Guestrin C (2016) Why should I trust you? Explaining the predictions of any classifier. Proc. 22nd ACM SIGKDD Internat. Conf. Knowledge Discovery Data Mining (ACM, New York), 1135–1144.Google Scholar
• Roberts ME, Stewart BM, Airoldi EM (2016) A model of text for experimentation in the social sciences. J. Amer. Statist. Assoc. 111(515):988–1003.Crossref, Google Scholar
• Roberts ME, Stewart BM, Tingley D (2019) stm: An R package for structural topic models. J. Statist. Softw. 91(2):1–40.Crossref, Google Scholar
• Roels G, Staats BR (2021) OM forum—People‐centric operations: Achievements and future research directions. Manufacturing Service Oper. Management 23(4):745–757.Link, Google Scholar
• Roth AE, Peranson E (1999) The redesign of the matching market for American physicians: Some engineering aspects of economic design. Amer. Econom. Rev. 89(4):748–780.Crossref, Google Scholar
• Ryzhov IO, Han B, Bradić J (2016) Cultivating disaster donors using data analytics. Management Sci. 62(3):849–866.Link, Google Scholar
• Settles B (2009) Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin–Madison, Madison.Google Scholar
• Siemsen E, Aloysius J (2020) Supply chain analytics and the evolving work of supply chain managers. White paper for the Association for Supply Chain Management, Wisconsin School of Business, Madison, WI.Google Scholar
• Soll JB, Milkman KL, Payne JW (2015) A user’s guide to debiasing. Keren G, Wu G, eds. The Wiley Blackwell Handbook of Judgment and Decision Making (John Wiley & Sons, Hoboken, NJ).Crossref, Google Scholar
• Sun J, Zhang DJ, Hu H, Van Mieghem JA (2022) Predicting human discretion to adjust algorithmic prescription: A large-scale field experiment in warehouse operations. Management Sci. 68(2):846–865.Link, Google Scholar
• Taylor J (2016) Quantilizers: A safer alternative to maximizers for limited optimization. The Workshops of the Thirtieth AAAI Conference on Artificial Intelligence, Technical Report WS-16-02, AAAI Press, Palo Alto, CA.Google Scholar
• Thaler RH, Sunstein CR (2009) Nudge (Penguin Books, New York).Google Scholar
• Thorp HH (2024) Genuine images in 2024. Science 383:7.Crossref, Google Scholar
• Uzialko A (2024) Artificial insurance? How machine learning is transforming underwriting. Business News Daily (April 12), https://www.businessnewsdaily.com/10203-artificial-intelligence-insurance-industry.html.Google Scholar
• Wang J, Zhou Y-P (2018) Impact of queue configuration on service time: Evidence from a supermarket. Management Sci. 64(7):3055–3075.Link, Google Scholar
• Weiss K, Khoshgoftaar TM, Wang DD (2016) A survey of transfer learning. J. Big Data 3(1):1–40.Crossref, Google Scholar
• West DM (2021) Using AI and machine learning to reduce government fraud. Brookings (September 10), https://www.brookings.edu/research/using-ai-and-machine-learning-to-reduce-government-fraud/.Google Scholar
• Zhang D, Cao X (2022) The impact of forced intervention on AI adoption. Working paper, CUHK Business School, Ma Liu Shui, Hong Kong.Google Scholar
• Zhang L, Wang S, Liu B (2018) Deep learning for sentiment analysis: A survey. Wiley Interdiscip. Rev. Data Min. Knowledge Discov. 8(4):e1253.Crossref, Google Scholar
• Zhao P, Yu B (2006) On model selection consistency of lasso. J. Machine Learn. Res. 7:2541–2563.Google Scholar