Roles of Artificial Intelligence in Collaboration with Humans: Automation, Augmentation, and the Future of Work

References

• Acemoglu D, Restrepo P (2018) The race between man and machine: Implications of technology for growth, factor shares, and employment. Amer. Econom. Rev. 108(6):1488–1542.Crossref, Google Scholar
• Agrawal A, Gans J, Goldfarb A (2018) Prediction Machines: The Simple Economics of Artificial Intelligence (Harvard Business Press, Cambridge, MA).Google Scholar
• Agrawal A, Gans J, Goldfarb A (2024) AI adoption and system-wide change. J. Econom. Management Strategy 33(2):327–337.Google Scholar
• Amaya J, Holweg M (2024) Using algorithms to improve knowledge work. J. Oper. Management 70(3):482–513.Crossref, Google Scholar
• Asch SE (1955) Opinions and social pressure. Sci. Amer. 193(5):31–35.Crossref, Google Scholar
• Autor DH (2014) Polanyi’s Paradox and the Shape of Employment Growth (National Bureau of Economic Research, Cambridge, MA).Crossref, Google Scholar
• Autor DH (2015) Why are there still so many jobs? The history and future of workplace automation. J. Econom. Perspect. 29(3):3–30.Crossref, Google Scholar
• Autor DH, Levy F, Murnane RJ (2003) The skill content of recent technological change: An empirical exploration. Quart. J. Econom. 118(4):1279–1333.Crossref, Google Scholar
• Baird A, Maruping LM (2021) The next generation of research on IS use: A theoretical framework of delegation to and from agentic IS artifacts. MIS Quart. 45(1):315–341.Crossref, Google Scholar
• Balasubramanian N, Ye Y, Xu M (2022) Substituting human decision-making with machine learning: Implications for organizational learning. Acad. Management Rev. 47(3):448–465.Crossref, Google Scholar
• Bansal G, Nushi B, Kamar E, Lasecki WS, Weld DS, Horvitz E (2019) Beyond accuracy: The role of mental models in human-AI team performance. Proc. AAAI Conf. Human Comput. Crowdsourcing 7(1):2–11.Google Scholar
• Beam AL, Kohane IS (2016) Translating artificial intelligence into clinical care. JAMA 316(22):2368–2369.Crossref, Google Scholar
• Beer R, Qi A, Ríos I (2025) Behavioral externalities of process automation. Management Sci., ePub ahead of print July 2, https://doi.org/10.1287/mnsc.2024.05408.Google Scholar
• Blattberg RC, Hoch SJ (1990) Database models and managerial intuition: 50% model + 50% manager. Management Sci. 36(8):887–899.Link, Google Scholar
• Boland PJ, Proschan F, Tong YL (1989) Modelling dependence in simple and indirect majority systems. J. Appl. Probab. 26(1):81–88.Crossref, Google Scholar
• Bommasani R, Creel KA, Kumar A, Jurafsky D, Liang PS (2022) Picking on the same person: Does algorithmic monoculture lead to outcome homogenization? Adv. Neural Inform. Processing Systems 35:3663–3678.Google Scholar
• Bonaccio S, Dalal RS (2006) Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences. Organ. Behav. Human Decision Processes 101(2):127–151.Crossref, Google Scholar
• Bresnahan TF (2021) Artificial intelligence technologies and aggregate growth prospects. Diamond JW, Zodrow GR, eds. Prospects for Economic Growth in the United States (Cambridge University Press, Cambridge, UK), 132–172.Crossref, Google Scholar
• Broussard M (2018) Artificial Unintelligence: How Computers Misunderstand the World (MIT Press, Cambridge, MA).Crossref, Google Scholar
• Brynjolfsson E, Mitchell T (2017) What can machine learning do? Workforce implications. Science 358(6370):1530–1534.Crossref, Google Scholar
• Brynjolfsson E, Mitchell T, Rock D (2018) What can machines learn and what does it mean for occupations and the economy? AEA Papers Proc. 108:43–47.Crossref, Google Scholar
• Chekroud AM, Hawrilenko M, Loho H, Bondar J, Gueorguieva R, Hasan A, Kambeitz J, et al. (2024) Illusory generalizability of clinical prediction models. Science 383(6679):164–167.Crossref, Google Scholar
• Chen C, Jain N, Karamshetty V (2023) Algorithm-human-algorithm: A new classification approach to integrating judgemental adjustments. Proc. 44th Internat. Conf. Inform. Systems (Hyderabad, India).Google Scholar
• Condorcet M D (1785) Essay on the Application of Analysis to the Probability of Majority Decisions (Imprimerie Royale, Paris).Google Scholar
• Dell’Acqua F, McFowland E, Mollick ER, Lifshitz-Assaf H, Kellogg K, Rajendran S, Krayer L, Candelon F, Lakhani KR (2023) Navigating the jagged technological frontier: Field experimental evidence of the effects of AI on knowledge worker productivity and quality. Working paper, Harvard Business School Technology & Operations Management Unit, Cambridge, MA.Google Scholar
• Dellermann D, Ebel P, Söllner M, Leimeister JM (2019) Hybrid intelligence. Bus. Inform. Systems Engrg. 61(5):637–643.Crossref, Google Scholar
• Donahue K, Chouldechova A, Kenthapadi K (2022) Human-algorithm collaboration: Achieving complementarity and avoiding unfairness. Proc. 2022 ACM Conf. Fairness Accountability Transparency (Seoul, South Korea), 1639–1656.Google Scholar
• Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639):115–118.Crossref, Google Scholar
• Frank MR, Autor D, Bessen JE, Brynjolfsson E, Cebrian M, Deming DJ, Feldman M, Groh M, Lobo J, Moro E (2019) Toward understanding the impact of artificial intelligence on labor. Proc. Natl. Acad. Sci. USA 116(14):6531–6539.Crossref, Google Scholar
• Fügener A, Grahl J, Gupta A, Ketter W (2021) Will humans-in-the-loop become borgs? Merits and pitfalls of working with AI. MIS Quart. 45(3):1527–1556.Crossref, Google Scholar
• Fügener A, Grahl J, Gupta A, Ketter W (2022) Cognitive challenges in human–artificial intelligence collaboration: Investigating the path toward productive delegation. Inform. Systems Res. 33(2):678–696.Link, Google Scholar
• Geirhos R, Meding K, Wichmann FA (2020) Beyond accuracy: Quantifying trial-by-trial behaviour of CNNs and humans by measuring error consistency. Adv. Neural Inform. Processing Systems 33:13890–13902.Google Scholar
• Geirhos R, Narayanappa K, Mitzkus B, Thieringer T, Bethge M, Wichmann FA, Brendel W (2021) Partial success in closing the gap between human and machine vision. Adv. Neural Inform. Processing Systems 34:23885–23899.Google Scholar
• Graesser AC, Fiore SM, Greiff S, Andrews-Todd J, Foltz PW, Hesse FW (2018) Advancing the science of collaborative problem solving. Psych. Sci. Public Interest 19(2):59–92.Crossref, Google Scholar
• Hekler A, Utikal JS, Enk AH, Hauschild A, Weichenthal M, Maron RC, Berking C, et al. (2019) Superior skin cancer classification by the combination of human and artificial intelligence. Eur. J. Cancer 120:114–121.Crossref, Google Scholar
• Jain H, Padmanabhan B, Pavlou PA, Raghu TS (2021) Editorial for the special section on humans, algorithms, and augmented intelligence: The future of work, organizations, and society. Inform. Systems Res. 32(3):675–687.Link, Google Scholar
• Jussupow E, Spohrer K, Heinzl A, Gawlitza J (2021) Augmenting medical diagnosis decisions? An investigation into physicians’ decision-making process with artificial intelligence. Inform. Systems Res. 32(3):713–735.Link, Google Scholar
• Karush W (1962) A generalalgorithm for the optimal distribution of effort. Management Sci. 9(1):50–72.Link, Google Scholar
• Kesavan S, Kushwaha T (2020) Field experiment on the profit implications of merchants’ discretionary power to override data-driven decision-making tools. Management Sci. 66(11):5182–5190.Link, Google Scholar
• Kleinberg J, Raghavan M (2021) Algorithmic monoculture and social welfare. Proc. Natl. Acad. Sci. USA 118(22):e2018340118.Crossref, Google Scholar
• Lake BM, Salakhutdinov R, Tenenbaum JB (2015) Human-level concept learning through probabilistic program induction. Science 350(6266):1332–1338.Crossref, Google Scholar
• Lake BM, Ullman TD, Tenenbaum JB, Gershman SJ (2017) Building machines that learn and think like people. Behav. Brain Sci. 40:e253.Crossref, Google Scholar
• Lebovitz S, Levina N, Lifshitz-Assaf H (2021) Is AI ground truth really true? The dangers of training and evaluating AI tools based on experts’ know-what. MIS Quart. 45(3):1501–1525.Crossref, Google Scholar
• Lebovitz S, Lifshitz-Assaf H, Levina N (2022) To engage or not to engage with AI for critical judgments: How professionals deal with opacity when using AI for medical diagnosis. Organ. Sci. 33(1):126–148.Link, Google Scholar
• LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444.Crossref, Google Scholar
• Lindebaum D, Vesa M, Den Hond F (2020) Insights from “the machine stops” to better understand rational assumptions in algorithmic decision making and its implications for organizations. Acad. Management Rev. 45(1):247–263.Crossref, Google Scholar
• List C, Goodin RE (2001) Epistemic democracy: Generalizing the Condorcet jury theorem. J. Political Philos. 9(3):277–306.Crossref, Google Scholar
• Madras D, Pitassi T, Zemel R (2018) Predict responsibly: Improving fairness and accuracy by learning to defer. Adv. Neural Inform. Processing Systems 31:6150–6160.Google Scholar
• Maedche A, Legner C, Benlian A, Berger B, Gimpel H, Hess T, Hinz O, Morana S, Söllner M (2019) AI-based digital assistants. Bus. Inform. Systems Engrg. 61(4):535–544.Crossref, Google Scholar
• McGrath JE (1984) Groups: Interaction and Performance (Prentice-Hall, Englewood Cliffs, NJ).Google Scholar
• Michelucci P, Dickinson JL (2016) The power of crowds. Science 351(6268):32–33.Crossref, Google Scholar
• Minsky M, Papert S (1969) Perceptrons (MIT Press, Cambridge, MA).Google Scholar
• Mozannar H, Sontag D (2020) Consistent estimators for learning to defer to an expert. Proc. 37th Internat. Conf. Machine Learn. (JMLR.org), 7076–7087.Google Scholar
• Orlikowski WJ (2002) Knowing in practice: Enacting a collective capability in distributed organizing. Organ. Sci. 13(3):249–273.Link, Google Scholar
• Palley AB, Soll JB (2019) Extracting the wisdom of crowds when information is shared. Management Sci. 65(5):2291–2309.Abstract, Google Scholar
• Polanyi M (1966) The logic of tacit inference. Philosophy 41(155):1–18.Crossref, Google Scholar
• Puranam P (2021) Human–AI collaborative decision-making as an organization design problem. J. Organ. Design 10(2):75–80.Crossref, Google Scholar
• Raghu M, Blumer K, Corrado G, Kleinberg J, Obermeyer Z, Mullainathan S (2019) The algorithmic automation problem: Prediction, triage, and human effort. Preprint, submitted March 28, https://arxiv.org/abs/1903.12220.Google Scholar
• Rai A, Constantinides P, Sarker S (2019) Editor’s comments: Next generation digital platforms: Toward human-AI hybrids. MIS Quart. 43(1):iii–ix.Crossref, Google Scholar
• Raisch S, Krakowski S (2021) Artificial intelligence and management: The automation–augmentation paradox. Acad. Management Rev. 46(1):192–210.Crossref, Google Scholar
• Rosenfeld A, Solbach MD, Tsotsos JK (2018) Totally looks like-how humans compare, compared to machines. Proc. IEEE Conf. Comput. Vision Pattern Recognition Workshop (IEEE Computer Society, Washington, DC), 1961–1964.Google Scholar
• Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M (2015) ImageNet large scale visual recognition challenge. Internat. J. Comput. Vis. 115(3):211–252.Crossref, Google Scholar
• Ryle G (1945) Knowing how and knowing that: The presidential address. Proc. Aristotelian Soc. 46(1):1–16.Crossref, Google Scholar
• Samuel J, Zheng Z (E), Mookerjee V (2024) Task characteristics and incentives in collaborative problem solving: Evidence from three field experiments. Inform. Systems Res. 35(1):414–433.Link, Google Scholar
• Schuetz S, Venkatesh V (2020) The rise of human machines: How cognitive computing systems challenge assumptions of user-system interaction. J. Assoc. Inform. Systems 21(2):460–482.Google Scholar
• Simon HA (1957) Models of Man; Social and Rational (Wiley, New York).Google Scholar
• Smith BC (2019) The Promise of Artificial Intelligence: Reckoning and Judgment (MIT Press, Cambridge, MA).Crossref, Google Scholar
• Steyvers M, Tejeda H, Kerrigan G, Smyth P (2022) Bayesian modeling of human–AI complementarity. Proc. Natl. Acad. Sci. USA 119(11):e2111547119.Crossref, Google Scholar
• Sutton RS, Barto AG (2018) Reinforcement Learning: An Introduction (MIT Press, Cambridge, MA).Google Scholar
• Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z (2016) Rethinking the inception architecture for computer vision. Proc. IEEE Conf. Comput. Vision Pattern Recognition (Las Vegas, NV), 2818–2826.Google Scholar
• Tschandl P, Rosendahl C, Akay BN, Argenziano G, Blum A, Braun RP, Cabo H, et al. (2019) Expert-level diagnosis of nonpigmented skin cancer by combined convolutional neural networks. JAMA Dermatology 155(1):58–65.Crossref, Google Scholar
• Tversky A, Kahneman D (1974) Judgment under uncertainty: Heuristics and biases. Science 185(4157):1124–1131.Crossref, Google Scholar
• Walzner DD, Poreschack LM, Fuegener A, Schiffels S, Denz C (2023) Division of labor between humans and algorithms in healthcare: The case of surgery duration predictions. Proc. 44th Internat. Conf. Inform. Systems (Hyderabad, India).Google Scholar
• Yaniv I, Kleinberger E (2000) Advice taking in decision making: Egocentric discounting and reputation formation. Organ. Behav. Human Decision Processes 83(2):260–281.Crossref, Google Scholar